-- Logs begin at Tue 2022-08-09 17:06:25 UTC, end at Tue 2022-08-09 18:18:38 UTC. -- Aug 09 17:47:43.212730 dv-cinder-836083-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 17:47:43.220137 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 17:47:43 2022] *** Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: nodename: dv-cinder-836083-11-iscsi Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: machine: x86_64 Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: clock source: unix Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: pcre jit disabled Aug 09 17:47:43.222111 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: detected number of CPU cores: 4 Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: current working directory: / Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: detected binary path: /usr/bin/uwsgi-core Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: your processes number limit is 47680 Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: your memory page size is 4096 bytes Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: detected max file descriptor number: 2048 Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: lock engine: pthread robust mutexes Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: thunder lock: enabled Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 17:47:43.222696 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 17:47:43.263215 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: Python main interpreter initialized at 0x562eba96d9c0 Aug 09 17:47:43.263215 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: python threads support enabled Aug 09 17:47:43.263215 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: your server socket listen backlog is limited to 100 connections Aug 09 17:47:43.263215 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: your mercy for graceful operations on workers is 90 seconds Aug 09 17:47:43.263611 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 17:47:43.263691 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: *** Operational MODE: preforking *** Aug 09 17:47:43.263930 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: *** uWSGI is running in multiple interpreter mode *** Aug 09 17:47:43.263930 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: spawned uWSGI master process (pid: 103192) Aug 09 17:47:43.264141 dv-cinder-836083-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 17:47:43.266040 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: spawned uWSGI worker 1 (pid: 103193, cores: 1) Aug 09 17:47:43.266040 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: spawned uWSGI worker 2 (pid: 103194, cores: 1) Aug 09 17:47:43.266040 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 17:47:43.920382 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 17:47:43.947692 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 17:47:45.014619 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:47:45.014619 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: from cryptography.utils import int_from_bytes Aug 09 17:47:45.015232 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:47:45.015232 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: from cryptography.utils import int_from_bytes Aug 09 17:47:45.025792 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:47:45.025792 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: from cryptography.utils import int_from_bytes Aug 09 17:47:45.026258 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:47:45.026258 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: from cryptography.utils import int_from_bytes Aug 09 17:47:47.517354 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 17:47:47.517919 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 17:47:47.518012 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 17:47:47.518012 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 17:47:47.518443 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 17:47:47.518443 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 17:47:47.518600 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 17:47:47.518680 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 17:47:47.518828 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 17:47:47.519086 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.519195 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 17:47:47.519406 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.519510 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.519723 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.519827 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.520041 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.520138 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.520367 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.520454 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.520673 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.520761 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.520986 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.521076 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.521297 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.521404 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.521623 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.521717 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.521875 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.521964 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.522186 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.522307 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.522496 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.522600 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-11-iscsi {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.522808 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.522893 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-11-iscsi {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.523130 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.523249 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.523436 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.523522 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.523741 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.523828 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.524037 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.524210 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.524870 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.524966 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.525174 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.525269 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.525485 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.525659 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.525977 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.526113 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.526286 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.526410 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.526589 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.526714 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.526901 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.527059 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.527279 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.527374 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.527558 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.527647 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.527865 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.527961 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.528182 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.528307 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.528490 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.528584 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.528795 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.528880 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.529101 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.529188 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-11-iscsi {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.529484 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.529585 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-11-iscsi {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.529792 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.529877 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.530100 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.530184 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.530411 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.530511 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.530801 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.530899 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.531137 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.531271 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.531438 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.531528 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.531754 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.531861 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.532055 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.532143 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.532371 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.532464 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.532693 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.532788 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.532995 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.533082 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.533305 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.533392 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.533601 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.533696 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.533903 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.533997 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.534203 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.534290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.534506 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.534601 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.534801 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.534886 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.535118 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.535209 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.535363 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.535462 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.535662 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.535761 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.535967 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.536053 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.536277 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.536371 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.536593 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.536690 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.536838 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.536926 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.537081 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.537170 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.537383 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.537487 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.537691 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.537787 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.537993 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.538079 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.538294 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.538387 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.538594 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.538694 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.538894 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.539001 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.539217 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.539312 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.539517 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.539616 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.539816 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.539903 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.540661 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.540751 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.540973 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.541069 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.541280 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.541364 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.541593 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.541681 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.541892 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.541987 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.542204 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.542291 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.542518 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.542604 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.542829 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.542924 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.543157 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.543246 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.543477 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.543562 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.543790 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.543867 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.544094 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.544185 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.544405 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.544498 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.544720 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.544807 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.545020 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.545104 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.545320 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.545415 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.545621 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.545707 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.545923 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.546017 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.546242 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.546347 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.546537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.546639 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.546781 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.546867 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.547096 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.547201 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.547396 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.547488 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.547700 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.547785 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.547997 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.548096 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.548298 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.548391 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.548596 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.548682 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.548888 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.548976 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.549184 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.549269 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.549480 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.549567 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.549777 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.549872 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.550074 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.550161 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.550372 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.550464 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.550673 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.550768 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.550987 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.551073 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.551283 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.551370 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.551580 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.551667 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.551881 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.551971 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.552190 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.552275 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.552488 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.552615 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.552786 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.552884 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.553084 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.553184 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.553384 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.553472 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.553688 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.553782 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.553984 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.554069 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.554282 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.554371 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.554588 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.554673 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.554884 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.555014 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.555221 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.555309 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.555544 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.555634 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.555865 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.555965 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.556167 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.556252 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.556469 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.556553 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.556762 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.556857 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.557060 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.557146 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.557362 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.557447 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.557660 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.557761 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.557957 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.558044 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.558252 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.558337 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.558548 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.558649 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.558842 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.558928 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.559160 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.559264 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.559456 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.559556 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.559753 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.559849 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.560047 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.560134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.560343 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.560429 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.560658 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.560744 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.560956 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.561042 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.561256 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.561343 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.561552 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.561675 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.561853 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.561938 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.562172 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:47:47.562266 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.562493 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.562578 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.562818 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.562915 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.563150 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.563237 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.563477 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.563573 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.563801 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.563902 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.564115 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.564202 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.564421 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.564507 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.564730 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.564823 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.565043 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.565130 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.565346 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.565439 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.565651 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.565742 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.565955 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.566055 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.566262 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.566364 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.566570 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.566657 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.566884 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.566997 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.567216 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.567303 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.567528 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.567666 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.567843 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.567936 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.568146 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.568239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.568460 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.568547 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.568781 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.568867 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.569096 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.569183 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.569402 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.569497 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.569711 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.569796 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.570050 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.570138 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.570356 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.570443 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.570680 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.570767 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.571022 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.571121 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.571371 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.571461 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.571683 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.571824 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.571997 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.572101 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.572307 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.572401 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.572628 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.572716 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.572937 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.573036 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.573251 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.573346 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.573559 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.573652 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.573865 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.573962 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.574178 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.574276 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.574493 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.574580 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.574806 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.574905 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.575144 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.575243 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.575462 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.575549 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.575773 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.575863 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.576079 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.576172 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.576391 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.576483 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.576695 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.576789 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.577003 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.577090 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.577310 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.577403 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.577610 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.577698 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.577910 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.578004 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.578210 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.578298 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.578515 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.578603 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.578816 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.578903 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.579145 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.579234 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.579465 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.579553 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.579769 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.579856 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.580085 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.580188 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.580386 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.580473 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.580698 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.580786 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.581001 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.581097 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.581306 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.581394 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.581608 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.581701 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.581916 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.582010 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.582219 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.582307 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.582520 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.582606 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.582825 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.582961 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.583152 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.583241 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.583455 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.583549 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.583762 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.583849 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.584060 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.584155 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.584360 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.584455 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.584668 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.584764 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.584972 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.585061 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.585276 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.585362 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.585580 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.585669 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.585887 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.586011 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.586196 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.586284 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.586502 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.586589 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.587363 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.587459 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.587679 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.587781 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.588012 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.588110 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.588342 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.588437 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.588648 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.588744 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.588967 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.589054 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.589282 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.589369 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.589583 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.589678 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.589884 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.589970 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.590187 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.590285 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.590483 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.590587 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.590784 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.590878 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.591110 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.591198 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.591409 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.591508 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.591708 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.591803 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.592007 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.592095 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.592306 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.592395 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.592607 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.592692 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.592912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.593049 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.593214 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.593302 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.593514 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.593603 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.593811 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.593898 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.594109 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.594197 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.594408 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.594494 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.594733 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.594826 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.595063 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.595165 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.595403 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.595492 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.595713 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.595807 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.596029 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.596116 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.596335 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.596428 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.596645 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.596739 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.596949 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.597035 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.597255 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.597348 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.597562 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.597657 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.597866 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.597954 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.598175 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.598260 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.598478 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.598564 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.598791 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.598883 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.599115 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.599204 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.599435 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.599525 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.599740 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.599827 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.600052 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.600138 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.600350 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.600447 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.600657 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.600745 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.600969 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.601055 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.601307 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.601395 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.601616 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.601784 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.601932 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.602028 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.602237 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.602333 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.603136 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.603281 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.603690 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.603814 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.603900 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.603992 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.604073 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.604152 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.604604 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.604701 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.604918 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.605006 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.605224 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.605310 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.605536 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.605631 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.605841 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.605927 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.606158 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.606244 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.606464 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.606553 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.606778 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.606864 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.607102 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.607191 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.607568 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.607674 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.607743 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.607809 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.608051 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.608129 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.608355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.608433 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.608662 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.608750 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.608977 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.609064 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.609279 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.609357 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.609583 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.609670 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.609890 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.609974 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.610191 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.610278 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.610491 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.610566 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.610793 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.610891 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.611125 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.611251 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.611429 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.611505 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.611735 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.611824 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.612043 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.612130 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.612351 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.612491 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.612664 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.612886 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.612975 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.613262 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.613408 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.613579 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.613877 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.613975 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.614197 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.614471 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.614558 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.614813 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.614991 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.615165 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.615469 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.615563 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.615775 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.615865 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.616094 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.616181 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.616403 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.616491 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.616708 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.616794 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.617012 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.617104 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.617316 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.617410 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.617658 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.617746 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.617968 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.618107 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.618324 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.618412 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.618671 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.618772 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.619031 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.619170 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.619341 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.619465 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.619660 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.619917 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.620014 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.620242 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.620337 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.620556 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.620643 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.620874 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.620961 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.621180 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.621276 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.621487 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.621573 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.621794 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.621888 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.622105 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.622193 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.622409 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.622495 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.622720 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.622814 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.623048 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.623137 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.623358 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.623454 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.623667 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.623752 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.623971 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.624059 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.624275 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.624369 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.624584 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.624670 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.624892 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.625162 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.625250 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.625488 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.625575 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.625801 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.625885 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.626118 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.626368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.626468 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.626697 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.626784 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.627030 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.627132 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.627348 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.627436 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.627664 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.627752 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.627981 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.628077 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.628307 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.628472 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.628611 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.628697 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.628916 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.629004 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.629231 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.629327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.629535 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.629639 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.629837 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.629925 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.630140 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.630228 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.630444 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.630531 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.630743 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.630829 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.631070 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.631161 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.631366 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.631462 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.631667 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.631761 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.631965 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.632051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.632264 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.632352 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.632561 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.632651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.632861 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.632955 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.633170 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.633266 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.633471 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.633558 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.633800 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.633905 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.634101 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.634194 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.634402 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.634496 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.634707 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.634801 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.635026 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.635127 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.635327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.635422 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.635627 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.635723 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.635964 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.636051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.636264 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.636352 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.636598 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.636686 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.636921 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.637007 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.637375 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.637522 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.637670 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.637790 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.637914 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.637999 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.638152 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.638241 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.638452 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.638584 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.638753 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.638842 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.639075 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.639167 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.639381 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.639470 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.639684 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.639771 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.639980 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.640076 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.640281 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.640368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.640583 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.640670 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.640882 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.640976 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.641187 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.641274 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.641486 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.641575 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.641785 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.641879 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.642080 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.642167 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.642385 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.642471 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.642686 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.642782 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.642996 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.643087 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.643299 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.643389 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.643600 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.643687 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.643900 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.643993 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.644196 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.644283 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.644496 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.644583 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.644792 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.644880 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.645098 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.645184 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.645395 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.645491 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.645694 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.645780 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.645990 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.646130 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.646292 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.646418 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.646597 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.646684 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.646895 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.647010 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.647226 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.647313 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.647529 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.647627 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.647829 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.647975 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.648125 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.648220 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.648428 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.648516 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.648725 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.648821 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.649023 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.649111 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.649847 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.649943 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.650150 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.650245 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.650453 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.650541 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.650750 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.650836 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.651080 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.651174 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.651381 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.651467 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.651683 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.651779 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.651978 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.652065 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.652278 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.652364 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.652574 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.652660 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.652870 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.652959 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.653168 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.653269 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.653466 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.653579 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.653764 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.653881 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.654077 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.654185 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.654378 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.654543 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.654677 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.654820 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.654987 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.655199 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.655288 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.655506 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.655621 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.655821 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.655915 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.656141 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.656263 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.656456 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.656565 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.656769 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.656877 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.657082 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.657190 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.657386 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.657496 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.657700 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.657786 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.658009 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.658095 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.658320 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.658409 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.658624 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.658718 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.658929 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.659047 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.659270 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.659358 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.659582 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.659668 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.659881 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.659981 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.660196 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.660283 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.660503 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.660591 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.660809 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.660905 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.661115 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.661201 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.661423 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.661517 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.661734 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.661830 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.662032 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.662118 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.662334 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.662422 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.662638 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.662726 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.662938 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.663078 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.663262 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.663357 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.663565 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.663661 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.663869 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.663956 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.664175 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.664270 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.664478 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.664566 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.664782 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.664886 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.665623 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.665727 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.665926 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.666015 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.666230 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.666361 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.666533 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.666677 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.666832 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.666963 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.667179 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.667310 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.667485 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.667588 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.667784 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.667873 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.668085 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.668182 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.668381 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.668519 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.668685 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.668833 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.668986 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.669236 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.669468 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.669608 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.669711 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.669839 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.669994 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.670151 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.670292 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.670467 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.670596 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.670783 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.670903 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.671114 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.671239 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.671528 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.671623 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.671839 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.671926 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.672147 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.672356 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.672453 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.672666 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.672753 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.672971 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.673058 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.673275 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.673403 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.673572 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.673659 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.673869 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.674009 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.674173 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.674261 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.674488 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.674582 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.674785 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.674881 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.675104 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.675208 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.675404 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.675500 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.675718 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.675814 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.676016 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.676126 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.676330 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.676418 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.676739 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.676838 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.677045 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.677132 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.677346 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.677434 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.677722 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.677809 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.678041 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.678127 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.678346 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.678432 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.678653 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.678747 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.678963 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.679111 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.679301 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.679398 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.679602 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.679690 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.679908 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.679999 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.680211 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.680299 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.680554 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.680645 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.680862 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.680952 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.681168 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.681254 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.681477 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.681572 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.681781 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.681871 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.682098 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.682186 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.682415 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.682510 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.682723 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.682818 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.683059 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.683154 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.683440 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.683540 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.683765 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.683854 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.684068 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.684193 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.684385 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.684639 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.684802 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.684904 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.684985 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.685065 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.685272 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.685370 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.685575 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.685673 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.685873 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.685962 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.686175 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.686291 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.686492 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.686600 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.686795 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.686886 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.687122 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.687215 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.687426 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.687526 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.687728 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.687816 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.688028 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.688121 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.688326 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.688426 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.688640 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.688727 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.688937 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.689026 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.689251 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.689348 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.689556 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.689652 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.689870 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.689958 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.690176 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.690262 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.690473 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.690568 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.690774 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.690867 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.691097 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.691190 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.691398 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.691504 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.691702 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.691803 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.692002 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.692092 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.692334 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.692430 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.692634 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.692723 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.692948 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.693036 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.693270 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.693359 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.693592 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.693680 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.693895 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.693992 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.694208 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.694297 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.694527 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.694613 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.694827 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.694914 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.695160 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.695250 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.695468 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.695556 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.695766 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.695853 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.696064 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.696679 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.696895 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.696999 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.697197 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.697350 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.697493 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.697582 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.697790 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.697877 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.698091 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.698188 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.698390 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.698479 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.698687 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.698776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.699028 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.699134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.699322 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.699410 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.699620 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.699714 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.699922 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.700017 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.700225 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.700320 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.700526 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.700613 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.700824 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.700913 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.701122 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.701209 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.701458 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.701554 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.701758 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.701849 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.702163 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.702250 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.702484 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.702642 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.702803 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.702981 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.703155 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.703307 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.703473 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.703623 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.703790 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.703937 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.704105 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.704251 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.704413 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.704564 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.704727 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.704877 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.705042 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.705188 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.705356 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.705496 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.705810 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.705896 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.706122 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.706210 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.706434 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.706530 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.706785 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.706963 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.707129 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.707299 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.707424 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.707612 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.707724 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.707924 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.708033 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.708237 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.708333 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.708549 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.708644 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.708862 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.708950 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.709171 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.709338 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.709482 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.709580 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.709790 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.709879 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.710102 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.710199 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.710427 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.710516 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.710746 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.710843 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.711088 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.711181 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.711406 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.711498 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.711724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.711852 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.712608 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.712696 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.712914 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.713002 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.713227 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.713323 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.713541 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.713630 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.713855 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.713954 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.714166 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.714263 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.714473 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.714559 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.714785 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.714872 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.715118 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.715208 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.715430 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.715529 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.715739 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.715827 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.716053 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.716142 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.716365 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.716459 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.716667 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.716761 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.716974 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.717062 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.717283 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.717381 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.717590 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.717686 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.717907 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.717993 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.718225 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.718312 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.718537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.718744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.718832 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.719091 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.719253 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.719424 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.719520 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.719747 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.719960 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.720074 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.720271 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.720390 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.720599 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.720695 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.720920 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.721008 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.721241 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.721329 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.721553 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.721641 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.721865 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.721952 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.722186 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.722272 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.722490 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.722589 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.722791 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.722879 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.723123 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.723213 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.723426 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.723516 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.723723 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.723809 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.724038 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.724131 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.724342 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.724569 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.724657 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.724921 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.725008 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.725227 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.725314 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.725553 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.725753 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.725878 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.726099 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.726196 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.726413 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.726501 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.726736 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.726824 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.727082 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.727186 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.727416 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.727517 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.727722 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.727820 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.728042 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.728139 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.728344 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.728430 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.728644 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.728731 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.728953 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.729040 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.729513 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.729605 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.729814 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.729899 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.730116 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.730204 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.730418 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.730504 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.730723 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.730812 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.731047 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.731128 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.731355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.731442 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.731657 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.731755 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.731979 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.732067 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.732281 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.732368 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.732587 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.732682 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.732887 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.732975 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.733188 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.733274 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.733488 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.733586 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.733787 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.733876 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.734089 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.734176 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.734387 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.734482 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.734692 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.734780 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.735006 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.735097 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.735315 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.735418 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.735615 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.735703 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.735921 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.736008 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.736219 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.736308 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.736523 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.736610 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.736822 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.736910 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.737139 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.737234 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.737439 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.737526 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.737770 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.737856 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.738084 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.738173 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.738386 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.738472 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.738704 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.738792 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.739037 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.739276 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.739375 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.739610 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.739698 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.739931 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.740022 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.740271 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.740481 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.740606 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.740809 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.740906 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.741124 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.741212 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.741453 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.741540 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.741780 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.741880 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.742083 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.742170 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.742390 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.742484 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.742691 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.742780 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.743031 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.743124 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.743347 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.743436 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.743654 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.743742 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.743960 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.744047 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.744264 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.744352 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.744570 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.744657 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.744871 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.744965 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.745178 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.745265 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.745481 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.745570 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.745786 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.745872 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.746086 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.746185 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.746392 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.746521 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.746694 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.746792 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.747014 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.747117 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.747322 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.747438 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.747632 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.747754 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.747965 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.748065 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.748279 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.748374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.748589 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.748677 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.748898 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.748987 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.749205 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.749293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.749510 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.749599 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.749814 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.749947 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.750116 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.750210 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.750417 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.750505 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.750727 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.750854 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.751079 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.751193 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.751388 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.751511 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.751689 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.751829 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.752096 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.752184 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.752409 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.752505 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.752722 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.752817 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.753035 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.753130 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.753338 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.753435 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.753652 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.753738 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.753966 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.754099 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.754272 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.754362 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.754586 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.754679 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.754891 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.754993 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.755235 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.755332 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.755547 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.755640 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.755850 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.755938 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.756158 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.756247 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.756471 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.756557 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.756770 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.756870 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.757069 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.757157 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.757367 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.757453 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.757673 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.757768 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.757975 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.758061 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.758272 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.758360 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.758569 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.759251 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.759415 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.759503 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.759714 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.759801 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760011 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760107 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760307 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760403 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760604 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760693 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760905 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.760992 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.761203 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.761302 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.761497 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.761585 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.761795 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.761890 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.762094 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.762181 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.762391 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.762484 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.762688 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.762776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763010 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763101 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763312 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763412 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763611 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763701 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763908 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.763996 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.764203 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.764298 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.764498 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.764612 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.764825 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.764919 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.765153 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.765249 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.765463 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.765551 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.765780 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.765867 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.766087 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.766183 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.766402 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.766538 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.766708 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.766797 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.767048 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.767152 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.767406 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.767501 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.767671 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.767759 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.767975 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.768110 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.768283 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.768369 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.768593 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.768682 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.768896 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.768983 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.769203 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.769335 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.769510 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.769598 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.769815 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.769910 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.770120 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.770209 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.770426 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.770526 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.770747 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.770835 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.771071 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.771162 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.771383 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.771482 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.771694 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.771782 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.772007 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.772093 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.772317 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.772413 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.772622 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.772708 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.772930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.773016 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.773239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.773327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.773552 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.773638 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.773861 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.773948 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.774170 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.774340 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.775067 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.775169 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.775382 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.775471 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.775690 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.775779 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.775998 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.776085 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.776309 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.776405 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.776621 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.776719 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.776945 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.777041 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.777266 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.777362 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.777572 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.777660 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.777893 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.777981 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.778214 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.778310 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.778528 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.778614 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.778840 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.778927 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.779172 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.779274 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.779406 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 17:47:47.779498 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.779806 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.780113 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.780414 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:47:47.780651 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 17:47:47.932732 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO dbcounter [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Registered counter for database nova_api Aug 09 17:47:47.933150 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO dbcounter [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Registered counter for database nova_api Aug 09 17:47:47.953235 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_db.sqlalchemy.engines [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:47.956891 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_db.sqlalchemy.engines [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:47.959964 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writer thread running {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:47.963987 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writer thread running {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:48.016295 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.context [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96e3c306-cfbc-45b6-873c-ac9c25672dda(cell1) {{(pid=103193) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 17:47:48.018926 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.context [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96e3c306-cfbc-45b6-873c-ac9c25672dda(cell1) {{(pid=103194) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 17:47:48.020184 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:48.020662 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:48.022228 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:48.022680 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_concurrency.lockutils [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:48.022952 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:48.023173 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_concurrency.lockutils [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:48.023420 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:48.025297 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_concurrency.lockutils [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:48.026012 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_concurrency.lockutils [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:48.026152 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:48.026451 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_concurrency.lockutils [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:48.028072 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO dbcounter [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Registered counter for database nova_cell0 Aug 09 17:47:48.028451 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_concurrency.lockutils [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:48.030436 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO dbcounter [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Registered counter for database nova_cell0 Aug 09 17:47:48.033864 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO dbcounter [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Registered counter for database nova_cell1 Aug 09 17:47:48.035879 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO dbcounter [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Registered counter for database nova_cell1 Aug 09 17:47:48.041834 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_db.sqlalchemy.engines [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:48.043366 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_db.sqlalchemy.engines [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:48.046852 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_db.sqlalchemy.engines [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:48.049162 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_db.sqlalchemy.engines [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:48.050897 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writer thread running {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:48.052664 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writer thread running {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:48.053725 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writer thread running {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:48.192026 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writer thread running {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:48.194622 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO dbcounter [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Registered counter for database nova_cell0 Aug 09 17:47:48.201969 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_db.sqlalchemy.engines [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:48.202600 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO dbcounter [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Registered counter for database nova_cell0 Aug 09 17:47:48.206561 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writer thread running {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:48.211677 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG oslo_db.sqlalchemy.engines [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:47:48.216154 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writer thread running {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:47:48.542458 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: WARNING keystonemiddleware.auth_token [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:47:48.549743 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: WARNING keystonemiddleware.auth_token [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:47:48.553687 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: WARNING keystonemiddleware.auth_token [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:47:48.561471 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: WARNING keystonemiddleware.auth_token [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:47:48.887664 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: WARNING keystonemiddleware.auth_token [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:47:48.893559 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: WARNING keystonemiddleware.auth_token [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:47:48.898762 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562eba96d9c0 pid: 103193 (default app) Aug 09 17:47:48.901378 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:48.902532 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 09 17:47:48.902926 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Aug 9 17:47:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:47:48.906103 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: WARNING keystonemiddleware.auth_token [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:47:48.912091 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: WARNING keystonemiddleware.auth_token [None req-54442ac1-ae0d-4271-ae39-c6ca90d7e496 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:47:48.917862 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562eba96d9c0 pid: 103194 (default app) Aug 09 17:49:06.150607 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:06.151655 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 09 17:49:06.152045 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:06.164760 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writing DB stats nova_api:SELECT=3 {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:06.165903 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writing DB stats nova_cell1:SELECT=3 {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:06.167007 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writing DB stats nova_cell0:SELECT=3 {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:06.168093 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:07.062417 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-c09c016c-6d23-43f2-9a6a-767d3f510841 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:07.098648 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-c09c016c-6d23-43f2-9a6a-767d3f510841 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939952 Aug 09 17:49:07.099871 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 9 17:49:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:09.356670 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:09.357708 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-b453959a-7bd6-42dd-8dcb-5b4064ad4ffa None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001380 Aug 09 17:49:09.363725 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:09.838176 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-29538268-014b-4d6a-8202-dc32471ea36c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "swap": 0, "vcpus": 1}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:09.858769 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:49:09.858769 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: warnings.warn(msg) Aug 09 17:49:09.892263 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-29538268-014b-4d6a-8202-dc32471ea36c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528063 Aug 09 17:49:09.901124 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:10.114900 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-56329496-f9cf-45b8-86db-2c9b1471b2e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:10.119265 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:49:10.119265 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: warnings.warn(msg) Aug 09 17:49:10.121895 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_api:SELECT=3 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:10.122806 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_cell1:SELECT=3 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:10.123724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_cell0:SELECT=3 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:10.124475 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:10.195569 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-56329496-f9cf-45b8-86db-2c9b1471b2e5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292445 Aug 09 17:49:10.196216 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 9 17:49:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:12.416678 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-29538268-014b-4d6a-8202-dc32471ea36c admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:12.417726 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-29538268-014b-4d6a-8202-dc32471ea36c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 09 17:49:12.418121 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:13.122805 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-39b9a339-3a62-4335-a3be-da6540072eda admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:13.143325 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:49:13.143325 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: warnings.warn(msg) Aug 09 17:49:13.163105 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-39b9a339-3a62-4335-a3be-da6540072eda admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.738166 Aug 09 17:49:13.167495 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:13.175933 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-b11f508a-484c-455f-922b-9949bbaadfb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:13.179308 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:49:13.179308 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: warnings.warn(msg) Aug 09 17:49:13.211946 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-b11f508a-484c-455f-922b-9949bbaadfb3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039690 Aug 09 17:49:13.212713 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 9 17:49:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:15.436715 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-39b9a339-3a62-4335-a3be-da6540072eda admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:15.437721 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-39b9a339-3a62-4335-a3be-da6540072eda admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 09 17:49:15.439290 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:15.856717 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-e9a7a106-07d4-4821-b931-ab7676e60641 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "disk": 10, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:15.876699 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-e9a7a106-07d4-4821-b931-ab7676e60641 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432090 Aug 09 17:49:15.877382 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:15.889515 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-77ffcacf-f277-4ab4-9cd3-b26a8e19d985 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:15.912674 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-77ffcacf-f277-4ab4-9cd3-b26a8e19d985 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026784 Aug 09 17:49:15.913824 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 9 17:49:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:18.250202 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-e9a7a106-07d4-4821-b931-ab7676e60641 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:18.251250 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-e9a7a106-07d4-4821-b931-ab7676e60641 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 09 17:49:18.251650 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:18.732201 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-e9dbdc27-d893-4342-8eca-6903b0287561 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "id": "d3"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:18.757601 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-e9dbdc27-d893-4342-8eca-6903b0287561 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499947 Aug 09 17:49:18.758873 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:18.771643 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-fbe1b184-c7c0-4394-a7cb-1e9f1905113b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:18.802901 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-fbe1b184-c7c0-4394-a7cb-1e9f1905113b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035222 Aug 09 17:49:18.804765 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 9 17:49:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:21.040577 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-e9dbdc27-d893-4342-8eca-6903b0287561 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:21.041557 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-e9dbdc27-d893-4342-8eca-6903b0287561 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 09 17:49:21.051060 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:21.498024 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-b7c34aad-0712-4c8a-8695-2a4842cd32da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:21.522329 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-b7c34aad-0712-4c8a-8695-2a4842cd32da admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474041 Aug 09 17:49:21.523809 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 17:49:21.537110 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-f3eabf43-5fe8-41b2-bd76-cc2870385f28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:21.566918 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-f3eabf43-5fe8-41b2-bd76-cc2870385f28 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033839 Aug 09 17:49:21.567969 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 9 17:49:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:23.849912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-b7c34aad-0712-4c8a-8695-2a4842cd32da admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:23.850875 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-b7c34aad-0712-4c8a-8695-2a4842cd32da admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 09 17:49:23.851323 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:24.321781 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-72a26ca2-c771-436f-9236-20fdcba24f82 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:24.346655 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-72a26ca2-c771-436f-9236-20fdcba24f82 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.488235 Aug 09 17:49:24.347238 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 9 17:49:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:49:26.727433 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-b7c34aad-0712-4c8a-8695-2a4842cd32da admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:26.729203 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-b7c34aad-0712-4c8a-8695-2a4842cd32da admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002913 Aug 09 17:49:26.729913 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:27.200553 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-39eb6e65-8950-4669-bcfc-e72a1cbf3769 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "swap": 0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:27.222088 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-39eb6e65-8950-4669-bcfc-e72a1cbf3769 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.482590 Aug 09 17:49:27.222679 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:27.238492 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-85db1d26-ee48-4583-889f-e9e7e7877b1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:27.265456 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-85db1d26-ee48-4583-889f-e9e7e7877b1f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031575 Aug 09 17:49:27.266055 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 9 17:49:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:29.638069 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-39eb6e65-8950-4669-bcfc-e72a1cbf3769 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:29.639115 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-39eb6e65-8950-4669-bcfc-e72a1cbf3769 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 09 17:49:29.639555 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:49:30.060199 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-4d0ad975-be91-49ec-bb7e-42f6176a6108 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "disk": 20, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:30.079070 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-4d0ad975-be91-49ec-bb7e-42f6176a6108 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433249 Aug 09 17:49:30.079626 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 17:49:30.092307 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-5389a2b1-b687-431f-903e-35e19c4371af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:30.117141 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-5389a2b1-b687-431f-903e-35e19c4371af admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028745 Aug 09 17:49:30.117704 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 9 17:49:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:32.344681 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-4d0ad975-be91-49ec-bb7e-42f6176a6108 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:32.345734 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-4d0ad975-be91-49ec-bb7e-42f6176a6108 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 09 17:49:32.346136 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:32.797349 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-5c727360-00f4-497c-b3b5-4afae3e49491 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:32.823128 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-5c727360-00f4-497c-b3b5-4afae3e49491 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.469642 Aug 09 17:49:32.835231 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-193e48f7-b842-47a7-b543-4544e8742205 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:32.840753 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:32.871178 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-193e48f7-b842-47a7-b543-4544e8742205 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039506 Aug 09 17:49:32.872060 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 9 17:49:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:35.143309 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-5c727360-00f4-497c-b3b5-4afae3e49491 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:35.144315 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-5c727360-00f4-497c-b3b5-4afae3e49491 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 09 17:49:35.144725 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:35.606276 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-24dc5963-da7f-4ef7-a504-ccf6d021926a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large"}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:35.627199 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-24dc5963-da7f-4ef7-a504-ccf6d021926a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476264 Aug 09 17:49:35.627915 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:35.639623 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-7479fd02-294b-4f0c-bf97-e6d86cf21299 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:35.665431 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-7479fd02-294b-4f0c-bf97-e6d86cf21299 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029391 Aug 09 17:49:35.666460 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 9 17:49:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:38.012462 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-24dc5963-da7f-4ef7-a504-ccf6d021926a admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:38.013484 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-24dc5963-da7f-4ef7-a504-ccf6d021926a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 09 17:49:38.013892 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:38.480722 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-7889c0dd-1f59-4864-a806-d2e948bbc88d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "id": "5"}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:38.501895 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-7889c0dd-1f59-4864-a806-d2e948bbc88d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.482019 Aug 09 17:49:38.502448 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 9 17:49:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:49:38.514922 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-87cc8aa3-614e-43b6-9bc0-e580d12c66f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:38.519977 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:38.541592 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-87cc8aa3-614e-43b6-9bc0-e580d12c66f7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030245 Aug 09 17:49:38.542510 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 9 17:49:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:57.980211 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-7889c0dd-1f59-4864-a806-d2e948bbc88d admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:57.981265 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-7889c0dd-1f59-4864-a806-d2e948bbc88d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 09 17:49:57.981795 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:49:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:58.411276 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-9e417c92-06d1-412e-b986-1211a5378dc6 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:58.429192 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-9e417c92-06d1-412e-b986-1211a5378dc6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.440324 Aug 09 17:49:58.429812 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 9 17:49:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:49:59.521677 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-7889c0dd-1f59-4864-a806-d2e948bbc88d admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:59.522683 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-7889c0dd-1f59-4864-a806-d2e948bbc88d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 09 17:49:59.523107 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:49:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:00.047986 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-a025e043-f945-4b33-ba85-1641d6ebb061 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:00.053489 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.wsgi [None req-a025e043-f945-4b33-ba85-1641d6ebb061 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-a025e043-f945-4b33-ba85-1641d6ebb061 admin admin] Request method failure captured: Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Accept: application/json Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Accept-Encoding: gzip, deflate Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Connection: keep-alive Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Content-Length: 0 Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Host: 10.222.0.52 Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Openstack-Api-Version: compute 2.90 Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Openstack-System-Scope: None Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: User-Agent: python-novaclient Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Auth-Token: gAAAAABi8p5Hi9oBsfq-8OlTbCgJpfUTw_Xtvend2er9t7GaUMt8A_1bLFz0HsRYdcYRvfDAmtPOap9iWCbfGokXu4h5PfKKkxs5poYt2bbXAacRCRAd5GWFZuaC1QvWfYWejF78bTEkthHYDUfSHZSS9-BfiLTEfDAdLVz5SyXLy5xK29IbA_M Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Domain-Id: None Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Domain-Name: None Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Identity-Status: Confirmed Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Is-Admin-Project: True Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Domain-Id: default Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Domain-Name: Default Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Name: admin Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Role: member,reader,admin Aug 09 17:50:00.057290 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Roles: member,reader,admin Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5aa4b373e99e4d74b2148fd834c1abbb", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant: admin Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant-Name: admin Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User: admin Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Domain-Id: default Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Domain-Name: Default Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Id: 654dd146616b4cbd8975ee15d286d26b Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Name: admin Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: method: > Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: exception: Flavor 42 could not be found. Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: action_args: {'id': '42'} Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:00.058912 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:00.060374 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.062051 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-a025e043-f945-4b33-ba85-1641d6ebb061 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:00.063460 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-a025e043-f945-4b33-ba85-1641d6ebb061 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397165 Aug 09 17:50:00.063460 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 9 17:49:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:50:00.069095 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-8b99aef2-c001-4574-bf33-72a9d6daefc8 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:00.073898 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:00.093195 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-8b99aef2-c001-4574-bf33-72a9d6daefc8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027601 Aug 09 17:50:00.093761 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 9 17:50:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:50:00.105403 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-5726c5b4-d5d8-4ca1-ae0e-2f851df533b6 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:00.129875 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-5726c5b4-d5d8-4ca1-ae0e-2f851df533b6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029781 Aug 09 17:50:00.130459 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 9 17:50:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:50:00.140671 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-748e74ae-62b3-4680-94ef-512704bd5418 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:00.147109 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.wsgi [None req-748e74ae-62b3-4680-94ef-512704bd5418 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-748e74ae-62b3-4680-94ef-512704bd5418 admin admin] Request method failure captured: Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Accept: application/json Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Accept-Encoding: gzip, deflate Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Connection: keep-alive Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Content-Length: 0 Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Host: 10.222.0.52 Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Openstack-Api-Version: compute 2.90 Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Openstack-System-Scope: None Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: User-Agent: python-novaclient Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Auth-Token: gAAAAABi8p5Hi9oBsfq-8OlTbCgJpfUTw_Xtvend2er9t7GaUMt8A_1bLFz0HsRYdcYRvfDAmtPOap9iWCbfGokXu4h5PfKKkxs5poYt2bbXAacRCRAd5GWFZuaC1QvWfYWejF78bTEkthHYDUfSHZSS9-BfiLTEfDAdLVz5SyXLy5xK29IbA_M Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Domain-Id: None Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Domain-Name: None Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Identity-Status: Confirmed Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Is-Admin-Project: True Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Domain-Id: default Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Domain-Name: Default Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Name: admin Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Role: member,reader,admin Aug 09 17:50:00.150355 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Roles: member,reader,admin Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5aa4b373e99e4d74b2148fd834c1abbb", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant: admin Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant-Name: admin Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User: admin Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Domain-Id: default Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Domain-Name: Default Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Id: 654dd146616b4cbd8975ee15d286d26b Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Name: admin Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: method: > Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: exception: Flavor 42 could not be found. Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: action_args: {'id': '42'} Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:00.151930 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:00.152846 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:00.154368 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-748e74ae-62b3-4680-94ef-512704bd5418 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:00.155786 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-748e74ae-62b3-4680-94ef-512704bd5418 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014768 Aug 09 17:50:00.155786 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 9 17:50:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 17:50:01.115840 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-5726c5b4-d5d8-4ca1-ae0e-2f851df533b6 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:01.116843 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-5726c5b4-d5d8-4ca1-ae0e-2f851df533b6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 09 17:50:01.117240 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:50:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:01.645353 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-8854c230-1114-46b3-b757-dee7fda67dda admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:01.650684 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.wsgi [None req-8854c230-1114-46b3-b757-dee7fda67dda admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-8854c230-1114-46b3-b757-dee7fda67dda admin admin] Request method failure captured: Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Accept: application/json Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Accept-Encoding: gzip, deflate Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Connection: keep-alive Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Content-Length: 0 Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Host: 10.222.0.52 Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Openstack-Api-Version: compute 2.90 Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Openstack-System-Scope: None Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: User-Agent: python-novaclient Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Auth-Token: gAAAAABi8p5JiFtSxAEUL8X48Xsaltn5ph50yPn6AahxcNjJSEvMG3fAMAUow0Zrr1Ssdwn5o5vO1AySloPqKYEg7cRPWt9QOk2kWntQw5jlIYPVFHCVM-ya3Rir3ViilR8PaRhbx0UPRx9sc0Uh2wc8gY_6UWSzRMRxvYz1qO9yBrLLqGABhDM Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Domain-Id: None Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Domain-Name: None Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Identity-Status: Confirmed Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Is-Admin-Project: True Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Domain-Id: default Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Domain-Name: Default Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Name: admin Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Role: member,reader,admin Aug 09 17:50:01.652231 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Roles: member,reader,admin Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5aa4b373e99e4d74b2148fd834c1abbb", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant: admin Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant-Name: admin Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User: admin Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Domain-Id: default Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Domain-Name: Default Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Id: 654dd146616b4cbd8975ee15d286d26b Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Name: admin Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: method: > Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: exception: Flavor 84 could not be found. Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: action_args: {'id': '84'} Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:01.653775 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:01.654724 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.656078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-8854c230-1114-46b3-b757-dee7fda67dda admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:01.657301 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-8854c230-1114-46b3-b757-dee7fda67dda admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398538 Aug 09 17:50:01.657301 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 9 17:50:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:50:01.663228 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-06ea365a-26af-4a56-b4a3-4cbe5ebf70fe admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:01.677973 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-06ea365a-26af-4a56-b4a3-4cbe5ebf70fe admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018285 Aug 09 17:50:01.678506 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 9 17:50:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:50:01.688444 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-3f8e7876-6786-4647-bca7-1359675e83c9 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:01.705721 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-3f8e7876-6786-4647-bca7-1359675e83c9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020722 Aug 09 17:50:01.706268 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 9 17:50:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:50:01.715749 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-36c130e4-e861-4223-a5ab-6a0aa712ee38 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:01.721144 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.wsgi [None req-36c130e4-e861-4223-a5ab-6a0aa712ee38 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-36c130e4-e861-4223-a5ab-6a0aa712ee38 admin admin] Request method failure captured: Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Accept: application/json Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Accept-Encoding: gzip, deflate Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Connection: keep-alive Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Content-Length: 0 Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Host: 10.222.0.52 Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Openstack-Api-Version: compute 2.90 Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Openstack-System-Scope: None Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: User-Agent: python-novaclient Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Auth-Token: gAAAAABi8p5JiFtSxAEUL8X48Xsaltn5ph50yPn6AahxcNjJSEvMG3fAMAUow0Zrr1Ssdwn5o5vO1AySloPqKYEg7cRPWt9QOk2kWntQw5jlIYPVFHCVM-ya3Rir3ViilR8PaRhbx0UPRx9sc0Uh2wc8gY_6UWSzRMRxvYz1qO9yBrLLqGABhDM Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Domain-Id: None Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Domain-Name: None Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Identity-Status: Confirmed Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Is-Admin-Project: True Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Domain-Id: default Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Domain-Name: Default Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Name: admin Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Role: member,reader,admin Aug 09 17:50:01.722651 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Roles: member,reader,admin Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5aa4b373e99e4d74b2148fd834c1abbb", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant: admin Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant-Name: admin Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User: admin Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Domain-Id: default Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Domain-Name: Default Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Id: 654dd146616b4cbd8975ee15d286d26b Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Name: admin Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: method: > Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: exception: Flavor 84 could not be found. Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: action_args: {'id': '84'} Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:01.723930 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:01.724776 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.726239 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-36c130e4-e861-4223-a5ab-6a0aa712ee38 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:01.727537 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-36c130e4-e861-4223-a5ab-6a0aa712ee38 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011806 Aug 09 17:50:01.727537 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 9 17:50:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:50:02.699997 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-3f8e7876-6786-4647-bca7-1359675e83c9 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:02.701047 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-3f8e7876-6786-4647-bca7-1359675e83c9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 09 17:50:02.701433 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:50:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:03.231293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-00c45654-6128-429d-9458-f36db292f1f7 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:03.237254 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.wsgi [None req-00c45654-6128-429d-9458-f36db292f1f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-00c45654-6128-429d-9458-f36db292f1f7 admin admin] Request method failure captured: Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Accept: application/json Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Accept-Encoding: gzip, deflate Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Connection: keep-alive Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Content-Length: 0 Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Host: 10.222.0.52 Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Openstack-Api-Version: compute 2.90 Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Openstack-System-Scope: None Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: User-Agent: python-novaclient Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Auth-Token: gAAAAABi8p5KbztsK4Tz05cJlzRizCF6AetyIlE9DWGiFEUPn58WJvP6yK4dWheQP668v7qHPqEqve8Dku1rupGZrzCuWa0b58658Ta9NCFbVBiyNRVsaKVnZJDrpVVNl9vsOa6-gfrOhS-UR2K-CdDE7Yma6ICNjNBXA3yd0rcL95ozOyu6790 Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Domain-Id: None Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Domain-Name: None Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Identity-Status: Confirmed Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Is-Admin-Project: True Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Domain-Id: default Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Domain-Name: Default Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Project-Name: admin Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Role: member,reader,admin Aug 09 17:50:03.238744 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Roles: member,reader,admin Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5aa4b373e99e4d74b2148fd834c1abbb", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant: admin Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-Tenant-Name: admin Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User: admin Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Domain-Id: default Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Domain-Name: Default Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Id: 654dd146616b4cbd8975ee15d286d26b Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: X-User-Name: admin Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: method: > Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: exception: Flavor 451 could not be found. Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: action_args: {'id': '451'} Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:03.240134 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:03.241005 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.242293 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-00c45654-6128-429d-9458-f36db292f1f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:03.243639 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-00c45654-6128-429d-9458-f36db292f1f7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.401215 Aug 09 17:50:03.243639 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 9 17:50:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:50:03.249841 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-2b317106-7f91-4e0f-8e92-e01f43fb9ca0 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:03.264455 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-2b317106-7f91-4e0f-8e92-e01f43fb9ca0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018139 Aug 09 17:50:03.265062 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 9 17:50:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:50:03.274736 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:03.289568 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018745 Aug 09 17:50:03.290798 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 9 17:50:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:50:03.299813 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-12488ba6-377a-435e-83c5-3efbe84a47a6 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:03.305025 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.wsgi [None req-12488ba6-377a-435e-83c5-3efbe84a47a6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-12488ba6-377a-435e-83c5-3efbe84a47a6 admin admin] Request method failure captured: Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Accept: application/json Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Accept-Encoding: gzip, deflate Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Connection: keep-alive Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Content-Length: 0 Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Host: 10.222.0.52 Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Openstack-Api-Version: compute 2.90 Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Openstack-System-Scope: None Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: User-Agent: python-novaclient Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Auth-Token: gAAAAABi8p5KbztsK4Tz05cJlzRizCF6AetyIlE9DWGiFEUPn58WJvP6yK4dWheQP668v7qHPqEqve8Dku1rupGZrzCuWa0b58658Ta9NCFbVBiyNRVsaKVnZJDrpVVNl9vsOa6-gfrOhS-UR2K-CdDE7Yma6ICNjNBXA3yd0rcL95ozOyu6790 Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Domain-Id: None Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Domain-Name: None Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Identity-Status: Confirmed Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Is-Admin-Project: True Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Domain-Id: default Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Domain-Name: Default Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Project-Name: admin Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Role: member,reader,admin Aug 09 17:50:03.306537 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Roles: member,reader,admin Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5aa4b373e99e4d74b2148fd834c1abbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5aa4b373e99e4d74b2148fd834c1abbb", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant: admin Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant-Id: 5aa4b373e99e4d74b2148fd834c1abbb Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-Tenant-Name: admin Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User: admin Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Domain-Id: default Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Domain-Name: Default Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Id: 654dd146616b4cbd8975ee15d286d26b Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: X-User-Name: admin Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: method: > Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: exception: Flavor 451 could not be found. Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: action_args: {'id': '451'} Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:03.308183 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:03.309327 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: ERROR nova.api.openstack.wsgi Aug 09 17:50:03.310605 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-12488ba6-377a-435e-83c5-3efbe84a47a6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:03.311843 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-12488ba6-377a-435e-83c5-3efbe84a47a6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011558 Aug 09 17:50:03.311843 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 9 17:50:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:50:04.284294 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:04.285358 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 09 17:50:04.285749 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:04.811574 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-f8df5a51-4d71-4a32-82bf-b01713728f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:04.830221 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-f8df5a51-4d71-4a32-82bf-b01713728f76 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406318 Aug 09 17:50:04.830758 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 9 17:50:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:50:05.805382 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:05.806443 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 09 17:50:05.806831 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:50:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:06.328820 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-b966dcbd-4bc1-4c56-9f27-68d90b91dc11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:06.347242 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-b966dcbd-4bc1-4c56-9f27-68d90b91dc11 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404467 Aug 09 17:50:06.347788 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 9 17:50:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:50:07.311978 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:07.313020 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 09 17:50:07.313428 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:50:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:07.839935 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-37176a58-6987-43c4-aa27-6f12f33a1783 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:07.859271 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-37176a58-6987-43c4-aa27-6f12f33a1783 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.410012 Aug 09 17:50:07.859809 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 9 17:50:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:50:08.830122 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:08.831191 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 09 17:50:08.831596 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:09.360892 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-243fbf26-052e-467e-b42a-e7dc737aa69f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:09.379560 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-243fbf26-052e-467e-b42a-e7dc737aa69f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408021 Aug 09 17:50:09.380088 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 9 17:50:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:50:10.356885 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:10.357893 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 09 17:50:10.358287 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:11.002405 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-a03dfbc4-2e6f-4fb8-8915-818a04c2287c admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:11.022826 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-a03dfbc4-2e6f-4fb8-8915-818a04c2287c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.524168 Aug 09 17:50:11.024090 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Aug 9 17:50:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:51:02.388792 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:02.389825 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-63abe60e-3c14-4ac3-a8fc-72c74334f1f5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 09 17:51:02.390222 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 9 17:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:51:02.400734 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:02.781471 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-3a763c00-5343-444d-b8ac-f9341440b2ed admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:02.801487 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-3a763c00-5343-444d-b8ac-f9341440b2ed admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405185 Aug 09 17:51:02.802100 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 9 17:51:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:51:02.826036 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-7fe7b39b-dee3-409b-97d3-1589b194c443 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:02.829467 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG dbcounter [-] [103194] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:02.835294 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-7fe7b39b-dee3-409b-97d3-1589b194c443 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013469 Aug 09 17:51:02.835818 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Aug 9 17:51:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:02.847206 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-4c6c49e9-90e1-45f4-9eb2-3e19d8979b35 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:02.854699 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-4c6c49e9-90e1-45f4-9eb2-3e19d8979b35 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011048 Aug 09 17:51:02.855254 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Aug 9 17:51:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:02.867029 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:02.876063 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012862 Aug 09 17:51:02.876521 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Aug 9 17:51:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:02.888279 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-ef418c38-22d2-4b0e-8e0e-680e184144a1 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:02.895787 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-ef418c38-22d2-4b0e-8e0e-680e184144a1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011630 Aug 09 17:51:02.896294 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Aug 9 17:51:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:00.333588 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:00.334603 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 09 17:54:00.335551 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:00.480627 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_api:SELECT=6 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:00.635779 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:00.638121 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:54:00.638121 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: warnings.warn(msg) Aug 09 17:54:00.639282 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:00.639752 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:00.640182 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:00.640884 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:00.641326 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:00.641739 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:00.675474 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-31bedd55-db93-4202-98d6-4d7a82344e05 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.200449 Aug 09 17:54:00.676046 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 9 17:54:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:54:01.502783 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:01.503850 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 09 17:54:01.504244 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:54:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:01.701076 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:01.703562 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:54:01.703562 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: warnings.warn(msg) Aug 09 17:54:01.704595 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:01.705065 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:01.705488 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:01.706188 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:01.706628 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:01.707078 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:01.726463 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-bb100fc3-1fea-42e1-adcc-702487451713 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080810 Aug 09 17:54:01.726944 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 9 17:54:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:54:12.963979 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:12.964989 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 09 17:54:12.965384 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:13.109338 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_cell0:SELECT=4 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:13.110056 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_cell1:SELECT=4 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:13.110671 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG dbcounter [-] [103193] Writing DB stats nova_api:SELECT=8 {{(pid=103193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:13.162793 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:13.165257 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:54:13.165257 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: warnings.warn(msg) Aug 09 17:54:13.166383 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:13.166848 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:13.167304 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:13.168030 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:13.168558 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:13.168966 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:13.194516 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-53d22abb-ef57-44a3-adfc-82a08c730466 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.089571 Aug 09 17:54:13.195674 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 9 17:54:13 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:54:14.033980 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: DEBUG nova.api.openstack.wsgi [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] Calling method '>' {{(pid=103194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:14.035050 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: INFO nova.api.openstack.requestlog [None req-2cb64840-e812-4e2a-a339-d30ab26d1475 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 09 17:54:14.035449 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: [pid: 103194|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 9 17:54:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:14.225095 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG nova.api.openstack.wsgi [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] Calling method '>' {{(pid=103193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:14.227477 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:54:14.227477 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: warnings.warn(msg) Aug 09 17:54:14.228600 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.229068 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.229498 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.230228 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.230673 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.231124 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: DEBUG oslo_concurrency.lockutils [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.252691 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: INFO nova.api.openstack.requestlog [None req-d5f6758b-9fe1-481f-ad34-3d7ef09b3f8a admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078425 Aug 09 17:54:14.253193 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: [pid: 103193|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 9 17:54:14 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:55:17.942250 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: Tue Aug 9 17:55:17 2022 - graceful shutdown triggered... Aug 09 17:55:17.942834 dv-cinder-836083-11-iscsi devstack@n-api.service[103194]: Gracefully killing worker 2 (pid: 103194)... Aug 09 17:55:17.943259 dv-cinder-836083-11-iscsi devstack@n-api.service[103193]: Gracefully killing worker 1 (pid: 103193)... Aug 09 17:55:17.942955 dv-cinder-836083-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 17:55:18.941641 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: worker 1 buried after 1 seconds Aug 09 17:55:18.941641 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: worker 2 buried after 1 seconds Aug 09 17:55:18.941641 dv-cinder-836083-11-iscsi devstack@n-api.service[103192]: goodbye to uWSGI. Aug 09 17:55:18.943316 dv-cinder-836083-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 17:55:18.943869 dv-cinder-836083-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 17:55:18.946673 dv-cinder-836083-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 17:55:18.959577 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 17:55:18 2022] *** Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: nodename: dv-cinder-836083-11-iscsi Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: machine: x86_64 Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: clock source: unix Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: pcre jit disabled Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: detected number of CPU cores: 4 Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: current working directory: / Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: detected binary path: /usr/bin/uwsgi-core Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: your processes number limit is 47680 Aug 09 17:55:18.962195 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: your memory page size is 4096 bytes Aug 09 17:55:18.963187 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: detected max file descriptor number: 2048 Aug 09 17:55:18.963187 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: lock engine: pthread robust mutexes Aug 09 17:55:18.963187 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: thunder lock: enabled Aug 09 17:55:18.963187 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 17:55:18.963187 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 17:55:19.003406 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: Python main interpreter initialized at 0x5591f3fca9c0 Aug 09 17:55:19.003406 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: python threads support enabled Aug 09 17:55:19.003406 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: your server socket listen backlog is limited to 100 connections Aug 09 17:55:19.003406 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: your mercy for graceful operations on workers is 90 seconds Aug 09 17:55:19.003828 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 17:55:19.003828 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: *** Operational MODE: preforking *** Aug 09 17:55:19.007152 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: *** uWSGI is running in multiple interpreter mode *** Aug 09 17:55:19.007152 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: spawned uWSGI master process (pid: 117868) Aug 09 17:55:19.007152 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: spawned uWSGI worker 1 (pid: 117885, cores: 1) Aug 09 17:55:19.007152 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: spawned uWSGI worker 2 (pid: 117886, cores: 1) Aug 09 17:55:19.007152 dv-cinder-836083-11-iscsi devstack@n-api.service[117868]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 17:55:19.004189 dv-cinder-836083-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 17:55:19.677931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 17:55:19.685563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 17:55:20.844709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:55:20.844709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: from cryptography.utils import int_from_bytes Aug 09 17:55:20.845371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:55:20.845371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: from cryptography.utils import int_from_bytes Aug 09 17:55:20.854899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:55:20.854899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: from cryptography.utils import int_from_bytes Aug 09 17:55:20.855474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:55:20.855474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: from cryptography.utils import int_from_bytes Aug 09 17:55:23.228323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 17:55:23.228952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 17:55:23.229335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 17:55:23.229443 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 17:55:23.229537 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 17:55:23.229631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 17:55:23.229721 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 17:55:23.229814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 17:55:23.229903 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 17:55:23.229986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 17:55:23.230075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.230164 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.230357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.230466 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.230675 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.230769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.231041 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.231201 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.231363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.231544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.231691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.231857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.232076 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.232232 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.232415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.232519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.232723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.232841 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.232982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.233079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.233383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.233496 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.233713 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-11-iscsi {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.233814 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-11-iscsi {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.234084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.234395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.234764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.234861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.235113 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.235240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.235425 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.235536 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.235751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.235866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.236061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.236168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.236394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.236590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.236729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.237233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.237540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.237846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.238087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.238410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.238523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.238733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.238850 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.239180 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.239283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.239422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.239511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.239740 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.239821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.240071 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.240208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.240464 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.240717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.240830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.241118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.241235 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-11-iscsi {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.241438 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.241610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.241846 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-11-iscsi {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.241987 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.242166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.242278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.242479 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.242589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.242794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.242899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.243245 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.243349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.243563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.243662 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.243881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.243992 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.244204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.244319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.244532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.244631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.244845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.244953 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.245174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.245311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.245497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.245596 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.246083 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.246225 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.246377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.247012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.247254 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.247388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.247538 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.247648 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.247851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.247975 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.248163 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.248304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.248406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.248492 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.248712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.248812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.248993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.249095 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.249298 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.249408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.249619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.249720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.249899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.250007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.250152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.250254 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.250477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.250577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.250723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.250824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.251063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.251165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.251386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.251502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.251694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.251794 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.252002 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.252107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.252303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.252414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.252608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.252708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.252912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.253013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.253218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.253324 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.253519 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.253625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.253825 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.253924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.254143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.254251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.254452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.254557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.254770 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.254861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.255098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.255209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.255419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.255514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.255742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.255834 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.256053 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.256157 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.256362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.256463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.256690 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.256792 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.257006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.257099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.257323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.257464 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.257624 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.257716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.257937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.258055 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.258241 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.258354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.258547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.258650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.258850 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.259112 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.259209 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.259303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.259451 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.259554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.259757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.259857 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.260047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.260140 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.260349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.260455 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.260669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.260761 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.261087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.261186 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.261441 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.261559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.261777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.261888 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.262128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.262793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.262946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.263132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.263304 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.263412 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.263622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.263731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.263930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.264041 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.264237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.264359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.264553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.264683 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.264908 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.265009 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.265220 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.265326 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.265527 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.265630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.265836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.265942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.266158 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.266263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.266484 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.273201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.273417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.273582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.273582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.273898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.274051 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.274202 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.274366 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.274515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.274671 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.274827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.275020 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.275187 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.275345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.275515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.275670 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.275824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.275977 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.276124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.276286 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.276440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.276593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.276741 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.276915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.277146 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.277301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.277483 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.277910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.278066 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.278296 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.278468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.278617 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.278769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.278917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.279122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.279278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.279442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.279589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.279742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.279910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.280066 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.280213 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.280426 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.280630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.280848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.281081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.281331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.281581 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.281774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.281979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.282131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.282279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.282438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.282601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.282757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.282963 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.283359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.283522 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.283672 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.283833 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.283992 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.284147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.284300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.284448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:55:23.284602 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.284826 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.284990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.285146 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.285301 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.285455 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.285612 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.285771 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.285918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.286064 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.286219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.286377 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.286533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.286699 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.286855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.287044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.287281 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.287443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.287614 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.287856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.288115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.288294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.288521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.288689 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.288846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.288993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.289159 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.289313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.289313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.289622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.289786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.289948 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.290095 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.290242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.290396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.290543 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.290704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.290859 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.291063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.291225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.291373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.291528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.291688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.291843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.291992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.292147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.292302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.292457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.292613 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.292767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.292915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.293133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.293302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.293617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.293775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.293930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.294079 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.294234 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.294388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.294545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.294699 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.294846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.295026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.295181 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.295349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.295506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.295660 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.295808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.295962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.296108 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.296255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.296415 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.296570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.296716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.296869 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.297016 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.297179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.297489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.297644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.297800 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.298039 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.298299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.298470 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.298714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.298876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.299042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.299195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.299357 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.299522 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.299682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.299845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.300004 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.300152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.300306 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.300470 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.300618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.300772 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.300925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.301081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.301229 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.301395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.301395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.301686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.301833 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.301989 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.302136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.302295 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.302452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.302599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.302745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.302899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.303164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.303331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.303505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.303826 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.303993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.304152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.304322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.304477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.304633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.304787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.304933 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.305079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.305239 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.305387 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.305533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.305688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.305836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.306000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.306157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.306305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.306451 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.306604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.306759 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.306916 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.307099 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.307258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.307517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.307681 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.307839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.308025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.308248 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.308502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.308662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.308928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.309583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.309742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.309902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.310056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.310212 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.310369 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.310516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.310677 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.310839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.311025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.311191 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.311347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.311509 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.311745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.311905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.312052 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.312229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.312449 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.312700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.312939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.313112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.313319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.313472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.313646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.313973 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.314130 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.314277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.314433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.314588 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.314736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.314893 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.315245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.315396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.315567 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.315716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.315877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.316025 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.316180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.316852 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.317016 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.317175 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.317333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.317489 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.317756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.317904 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.318061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.318242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.318499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.318752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.319017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.319186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.319345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.319501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.319658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.319821 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.319972 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.320128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.320276 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.320471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.320658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.320807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.321001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.321174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.321370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.321552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.322415 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.322594 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.322747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.322895 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.323098 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.323501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.323671 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.323839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.324182 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.324344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.324495 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.324688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.325349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.325506 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.325662 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.325810 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.325972 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.326121 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.326121 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.326408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.326567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.326714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.326875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.327053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.327223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.327379 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.327533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.327714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.327976 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.328263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.328424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.328675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.328947 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.329344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.329557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.329739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.329905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.330060 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.330213 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.330380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.330546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.330709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.330864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.331085 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.331258 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.331439 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.331595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.331756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.331922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.332077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.332229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.332459 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.332616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.332770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.332936 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.333090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.333244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.333408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.333618 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.333777 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.333931 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.334103 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.334389 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.334561 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.334716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.334877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.335054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.335224 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.335388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.335551 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.335706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.335878 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.336033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.336194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.336357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.336512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.336665 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.336819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.336972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.337134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.337134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.337439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.337593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.337753 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.337936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.338171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.338171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.338582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.338859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.339205 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.339436 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.339612 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.339775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.339940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.340104 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.340304 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.340475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.340644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.340799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.340960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.341153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.341319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.341482 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.341646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.341801 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.341963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.342117 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.342270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.342424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.342605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.342760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.342922 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.343100 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.343265 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.343434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.343658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.343820 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.343975 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.344128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.344281 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.344560 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.344723 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.344896 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.345058 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.345221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.345376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.345541 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.345695 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.345849 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.346002 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.346155 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.346308 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.346480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.346643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.346797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.346995 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.347172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.347335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.347500 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.347655 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.347817 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.347971 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.348123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.348400 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.348634 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.348820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.349055 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.349327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.349582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.349766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.349926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.350080 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.350244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.350406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.350568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.350739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.350901 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.351092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.351255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.351410 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.351582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.351771 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.351937 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.352093 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.352247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.352407 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.352575 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.352731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.352894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.353056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.353219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.353374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.353536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.353751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.353921 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.354086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.354242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.354396 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.354583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.354830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.354830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.355168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.355168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.355472 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.355627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.355781 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.356484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.356643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.356804 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.356971 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.357133 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.357296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.357452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.357614 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.357776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.357939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.358103 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.358267 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.358655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.358899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.359165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.359359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.359641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.359875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.360143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.360307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.360480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.360645 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.360813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.360969 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.361123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.361297 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.361461 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.361626 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.361781 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.361935 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.362096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.362096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.362400 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.362562 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.362724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.362879 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.363090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.363252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.363427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.363593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.363748 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.363949 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.364105 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.364267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.364431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.364600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.364755 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.365016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.365177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.365339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.365563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.365739 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.365902 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.366056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.366210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.366364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.366533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.366695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.366850 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.367034 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.367209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.367365 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.367534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.367701 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.367856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.368010 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.368165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.368318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.368481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.368732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.368910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.369154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.369386 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.369560 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.369820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.370073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.370265 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.370433 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.370590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.371081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.371245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.371407 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.371628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.372273 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.372427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.372595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.372752 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.372906 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.373061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.373225 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.373386 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.373555 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.373711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.373910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.374097 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.374293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.374562 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.374732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.374898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.375179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.375342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.375496 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.375673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.375836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.376001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.376163 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.376318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.376480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.376649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.376819 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.376980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.377135 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.377289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.377451 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.377627 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.377782 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.378063 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.378222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.378384 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.378549 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.378731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.378961 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.379163 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.379411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.379678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.379849 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.380013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.380380 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.380538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.380692 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.380692 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.381165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.381331 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.381486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.381653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.381817 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.381980 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.382150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.382305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.382459 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.382625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.382787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.383109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.383307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.383466 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.383622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.383787 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.384022 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.384194 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.384358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.384513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.384667 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.384829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.385005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.385202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.385488 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.385656 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.385819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.385983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.386139 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.386306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.386464 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.386627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.386783 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.386938 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.387172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.387354 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.387527 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.387690 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.387853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.388009 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.388173 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.388335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.388491 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.388644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.388806 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.389091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.389263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.389542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.389821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.389991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.390204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.390600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.390787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.390955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.391189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.391360 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.391530 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.391697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.391860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.392015 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.392180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.392420 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.392579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.392711 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.392954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.393118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.393309 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.393497 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.393666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.393838 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.394071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.394243 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.394452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.394570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.394809 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.395076 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.395252 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.395451 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.395745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.395936 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.396102 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.396275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.396432 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.396618 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.396775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.396902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.397156 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.397393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.397554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.397719 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.397925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.398090 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.398254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.398410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.398563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.398725 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.398725 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.399103 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.399367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.399566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.399833 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.400078 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.400248 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.400440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.400778 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.400942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.401105 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.401260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.401422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.401587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.401587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.401910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.402068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.402068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.402376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.402540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.402695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.402883 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.403057 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.403218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.403383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.403549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.403704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.403858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.404022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.404225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.404225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.404542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.404705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.404705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.405017 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.405180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.405349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.405504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.405666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.405935 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.406096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.406270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.406438 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.406594 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.406747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.406901 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.407236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.407404 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.407569 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.407731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.407886 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.408039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.408039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.408342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.408592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.408758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.408913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.408913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.409204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.409390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.409627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.409805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.410056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.410304 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.410468 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.410637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.410997 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.411162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.411329 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.411494 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.411656 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.411826 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.411997 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412572 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412667 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412761 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.412900 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413034 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413639 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413754 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.413992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414105 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414496 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414621 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.414744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.415221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.415346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.415461 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.415574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.415574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.415795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.415950 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416530 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416773 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416773 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416993 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.416993 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.417223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.417345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.417524 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.417689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.417855 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.418019 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.418185 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.418870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.419051 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.419211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.419211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.419504 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.419763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.419936 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.420192 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.420515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.420678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.420678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.421184 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.421358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.421521 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.421677 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.421830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.422000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.422000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.422304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.422460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.422633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.422788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.422955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.423148 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.423310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.423477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.423631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.423792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.423956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.424113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.424113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.424460 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.424617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.424782 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.424949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.425104 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.425258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.425412 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.425564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.425731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.425895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.426061 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.426323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.426484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.426638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.426803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.427003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.427168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.427335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.427502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.427666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.427835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.427998 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.428153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.428316 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.428472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.428625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.428790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.428945 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.429117 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.429279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.429434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.429676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.429943 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.430106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.430360 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.430622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.430790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.431079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.431416 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.431578 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.431753 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.431923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.432086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.432250 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.432406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.432561 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.432723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.432885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.433048 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.433217 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.433374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.433537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.433537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.433843 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.434058 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.434751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.434906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.435121 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.435277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.435431 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.435603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.435760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.435921 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436497 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.436721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.437683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.437842 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.438005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.438168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.438331 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.438494 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.438663 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.438834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.439033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.439212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.439366 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.439528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.439697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.439862 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.440118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.440281 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.440531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.440798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.440976 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.441140 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.441336 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.441664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.441827 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.441993 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.442156 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.442312 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.442474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.442630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.442784 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.442952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.443134 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.443300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.443463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.443630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.443791 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.443956 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.444112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.444266 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.444419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.444579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.444785 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.444959 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.445123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.445123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.445417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.445417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.445738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.445894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.446056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.446225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.446387 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.446646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.446824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.447043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.447206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.447360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.447525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.447681 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.447856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.448012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.448166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.448320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.448481 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.448635 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.448798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.449537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.449745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.449905 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.449905 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.450301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.450473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.450731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.451013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.451190 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.451348 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.451517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.452028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.452223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.452389 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.452552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.452722 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.452878 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.453039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.453206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.453368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.453524 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.453688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.453842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.453995 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.454148 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.454309 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.454464 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.454628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.454833 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.455023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.455197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.455362 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.455527 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.455683 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.455838 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.456000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.456155 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.456308 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.456471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.456655 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.456917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.457086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.457252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.457419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.457573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.457727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.457880 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.458034 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.458194 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.458358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.458513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.458513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.458805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.458965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.459167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.459333 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.459495 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.459649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.459811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.459811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.460113 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.460294 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.460538 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.460724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.461652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.461821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.462087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.462351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.462513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.462676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.462836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.463046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.463263 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.463428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.463592 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.463763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.463921 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.464074 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.464242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.464412 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.464567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.464724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.464724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.465069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.465069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.465493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.465651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.466414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.466585 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.466750 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.466945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.467227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.467401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.467574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.467732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.467924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.468088 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.468255 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.468411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.468565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.468719 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.468881 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.469036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.469212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.469375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.469529 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.469691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.469853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.470008 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.470170 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.470333 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.470515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.470776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.470967 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.471286 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.471457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.471651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.471898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.471898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.472299 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.472592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.472751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.472906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.473069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.473233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.473396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.473560 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.473722 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.473890 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.474060 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.474226 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.474380 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.474549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.474705 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.474865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.475079 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.475240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.475406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.475573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.475729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.475882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.476055 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.476209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.476373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.476537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.476693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.476848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.477002 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.477164 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.479619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.479829 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.479996 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.480163 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.480163 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.480476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.480647 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.481464 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.481569 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.481667 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.481757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.481852 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482226 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482328 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482423 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482520 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482608 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.482946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.483070 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.483210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.483352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.483486 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.483486 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.483830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.483998 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484098 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484237 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484635 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484810 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.484998 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485149 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485245 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485416 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485510 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485606 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.485982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486432 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486519 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.486869 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.487041 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.487189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.487189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.487485 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.487724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.487870 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488004 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488446 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.488963 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489469 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489645 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.489815 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.490409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.491483 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.491816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.491916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492022 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492257 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.492971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493895 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.493980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494065 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494149 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494494 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494679 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.494941 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495052 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495423 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.495959 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.496045 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.496130 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.496223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.496330 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.496426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.496557 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497140 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497244 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497608 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497712 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.497992 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498173 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498361 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498730 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498816 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.498903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499064 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499143 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499353 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.499925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500116 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500290 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500469 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500832 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.500924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501010 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501102 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501245 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501441 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501529 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501614 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501698 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.501965 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.502935 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503040 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503609 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.503915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504518 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504615 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504702 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.504956 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505149 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505237 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505237 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505462 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505558 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505746 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.505860 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506232 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506360 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506449 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.506959 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.507257 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.507382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.507496 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.507610 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.507763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.507886 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508010 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508390 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508637 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.508874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.509930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.510916 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.511068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.511207 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.511207 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.511483 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.511617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.511757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.511905 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.512011 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.512114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.512730 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.512826 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.512913 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.512988 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.512988 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513234 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.513969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.514472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.514472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:55:23.514472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 17:55:23.660148 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Registered counter for database nova_api Aug 09 17:55:23.679814 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Registered counter for database nova_api Aug 09 17:55:23.685768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.692766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:23.703522 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.710359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:23.749477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.context [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96e3c306-cfbc-45b6-873c-ac9c25672dda(cell1) {{(pid=117886) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 17:55:23.753528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.754003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.755611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.756343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.756782 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.758786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.760796 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Registered counter for database nova_cell0 Aug 09 17:55:23.765225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Registered counter for database nova_cell1 Aug 09 17:55:23.772873 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.774615 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.776736 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.context [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96e3c306-cfbc-45b6-873c-ac9c25672dda(cell1) {{(pid=117885) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 17:55:23.779930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:23.781459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.781935 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.783803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.784789 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.785315 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.787709 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.789845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Registered counter for database nova_cell0 Aug 09 17:55:23.794800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Registered counter for database nova_cell1 Aug 09 17:55:23.803066 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.805918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.812684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:23.814169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:23.930388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:23.941939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Registered counter for database nova_cell0 Aug 09 17:55:23.948764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.953275 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:23.978138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Registered counter for database nova_cell0 Aug 09 17:55:23.986470 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:55:23.991397 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:55:24.276923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:55:24.284853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:55:24.378807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:55:24.388211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:55:24.635815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:55:24.642855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-870c3404-42f2-4b7a-8291-f260df3da5f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:55:24.649667 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591f3fca9c0 pid: 117886 (default app) Aug 09 17:55:24.788954 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:55:24.795716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-dd58fb52-f397-44f9-9779-320f1632a7e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:55:24.802407 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591f3fca9c0 pid: 117885 (default app) Aug 09 17:56:00.639938 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:00.642023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:00.643336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:00.644375 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:02.048792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6f33a956-fc61-48b2-ae14-a8f9c5418d22 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Action: 'create', calling method: .version_select at 0x7f8c08894dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1681861651"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:04.912470 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6f33a956-fc61-48b2-ae14-a8f9c5418d22 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.283769 Aug 09 17:56:04.914017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Aug 9 17:56:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4287 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 17:56:04.937384 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:04.940388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:04.941664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:04.942721 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:05.358912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-803b8e65-6ef1-4d45-80f6-2b604fea30e0 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08900af0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:06.277152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-803b8e65-6ef1-4d45-80f6-2b604fea30e0 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795" status: 200 len: 346 microversion: 2.1 time: 1.315392 Aug 09 17:56:06.277152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 17:56:04 2022] GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 => generated 346 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:06.283882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-624ab989-ae37-4073-a564-249c5d371567 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Action: 'create', calling method: .version_select at 0x7f8c0870fb80>, body: {"snapshot": {"volume_id": "f6f30e23-805a-4195-a9cd-194744df2795", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1612449938"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:06.714777 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-624ab989-ae37-4073-a564-249c5d371567 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.455153 Aug 09 17:56:06.715580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1162 bytes} [Tue Aug 9 17:56:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:06.732012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-40270f55-0f50-4e8c-93b6-261d18ce1434 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c087bcc10>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:06.906303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-40270f55-0f50-4e8c-93b6-261d18ce1434 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 200 len: 287 microversion: 2.1 time: 0.183057 Aug 09 17:56:06.907319 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:06 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:06.920810 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9c5443c2-151d-4104-a1f7-f9bb33da5594 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08722d30>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:07.069291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9c5443c2-151d-4104-a1f7-f9bb33da5594 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.155416 Aug 09 17:56:07.070346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Aug 9 17:56:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:07.086447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-74b53918-d5b0-4840-9ad0-8021bc3e795c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c087843a0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:07.230219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-74b53918-d5b0-4840-9ad0-8021bc3e795c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 200 len: 287 microversion: 2.1 time: 0.147861 Aug 09 17:56:07.231502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:07 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:08.247505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-49da5684-c016-4e36-aff3-9291e88b1a8b tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08722af0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:08.310552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-49da5684-c016-4e36-aff3-9291e88b1a8b tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 200 len: 287 microversion: 2.1 time: 0.067882 Aug 09 17:56:08.312291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:08 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:09.329166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2dcb2a90-776d-444d-9d08-de851341e675 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08784a60>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:09.394255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2dcb2a90-776d-444d-9d08-de851341e675 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 200 len: 287 microversion: 2.1 time: 0.071513 Aug 09 17:56:09.399136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:09 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:10.407156 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-78f7ea00-29f7-4681-acbf-7ad3aa97457b tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08722550>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:10.488966 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-78f7ea00-29f7-4681-acbf-7ad3aa97457b tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 200 len: 287 microversion: 2.1 time: 0.085774 Aug 09 17:56:10.494075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:10 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:11.509903 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-73b77c67-8929-4fb0-bab0-ba1325fb7a4b tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c087bce50>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:11.613716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-73b77c67-8929-4fb0-bab0-ba1325fb7a4b tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 200 len: 288 microversion: 2.1 time: 0.113220 Aug 09 17:56:11.614731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:11 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:11.632477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c0bf832d-4483-4f70-8b43-178febc8d354 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c0870fee0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:11.786924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c0bf832d-4483-4f70-8b43-178febc8d354 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 202 len: 0 microversion: 2.1 time: 0.159437 Aug 09 17:56:11.790616 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Aug 9 17:56:11 2022] DELETE /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:56:11.799735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1f54d082-2025-459f-8b44-566ac4c3dcd4 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08784af0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:11.866048 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1f54d082-2025-459f-8b44-566ac4c3dcd4 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 200 len: 287 microversion: 2.1 time: 0.073370 Aug 09 17:56:11.866801 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:11 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:12.879838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7cf91727-a9ad-4df9-96b4-8a07feff463c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c0870fdc0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:12.925692 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-7cf91727-a9ad-4df9-96b4-8a07feff463c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] HTTP exception thrown: Snapshot 0901f122-285c-4cd4-8ce9-7c544775a6a7 could not be found. Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7cf91727-a9ad-4df9-96b4-8a07feff463c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Request method failure captured: Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 HTTP/1.1 Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p-wv58T50fAZxx78fhHJc86jGJBKzLsXf-7GLIiHRM7PV5tHsIOycE_HPy8MRX2Rpast3umt0ug_i1poItFRwLLgRjTkedAbxpmY3NHaFaMFz8R1eB5N44fTjal-tSZD5wCfRXCTWIc7ptXnU0YtCRVJm0XhfkrBZy9aQl4ynmdptI Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 17:56:12.930390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2d3d0d44ab748d5bcdc09452916b6bc", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 553aa53db51b4c8aaac26e81f0521f04 Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Snapshot 0901f122-285c-4cd4-8ce9-7c544775a6a7 could not be found. Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '0901f122-285c-4cd4-8ce9-7c544775a6a7'} Aug 09 17:56:12.931949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0901f122-285c-4cd4-8ce9-7c544775a6a7 could not be found. (HTTP 404) (Request-ID: req-801e7ace-3492-4dc4-963e-ccc5671c23d4) Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:12.934114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:56:12.935402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0901f122-285c-4cd4-8ce9-7c544775a6a7 could not be found. Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 17:56:12.936318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0901f122-285c-4cd4-8ce9-7c544775a6a7 could not be found. Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0901f122-285c-4cd4-8ce9-7c544775a6a7 could not be found. Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7cf91727-a9ad-4df9-96b4-8a07feff463c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Returning 404 to user: Snapshot 0901f122-285c-4cd4-8ce9-7c544775a6a7 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:56:12.937373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7cf91727-a9ad-4df9-96b4-8a07feff463c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7" status: 404 len: 111 microversion: 2.1 time: 0.058676 Aug 09 17:56:12.940478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 17:56:12 2022] GET /compute/v2.1/os-snapshots/0901f122-285c-4cd4-8ce9-7c544775a6a7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:56:12.944206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7cecea5e-0251-4392-b151-b066c4d9f685 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c087843a0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:13.138374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7cecea5e-0251-4392-b151-b066c4d9f685 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795" status: 202 len: 0 microversion: 2.1 time: 0.198303 Aug 09 17:56:13.140256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 7/14] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 17:56:12 2022] DELETE /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:56:13.148804 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c32accb0-00fc-4854-8522-375596244115 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c090961f0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:13.270006 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c32accb0-00fc-4854-8522-375596244115 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795" status: 200 len: 345 microversion: 2.1 time: 0.125708 Aug 09 17:56:13.270689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 17:56:13 2022] GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:14.288830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5a71333e-6a12-4a44-b06e-010b652fc28c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08784160>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:14.349359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-5a71333e-6a12-4a44-b06e-010b652fc28c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] HTTP exception thrown: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5a71333e-6a12-4a44-b06e-010b652fc28c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Request method failure captured: Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 HTTP/1.1 Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p-wv58T50fAZxx78fhHJc86jGJBKzLsXf-7GLIiHRM7PV5tHsIOycE_HPy8MRX2Rpast3umt0ug_i1poItFRwLLgRjTkedAbxpmY3NHaFaMFz8R1eB5N44fTjal-tSZD5wCfRXCTWIc7ptXnU0YtCRVJm0XhfkrBZy9aQl4ynmdptI Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 17:56:14.355171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2d3d0d44ab748d5bcdc09452916b6bc", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 553aa53db51b4c8aaac26e81f0521f04 Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'f6f30e23-805a-4195-a9cd-194744df2795'} Aug 09 17:56:14.357049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. (HTTP 404) (Request-ID: req-a5fda4ae-2658-4403-b53d-838f1c48c0bb) Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:56:14.361124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 17:56:14.364647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5a71333e-6a12-4a44-b06e-010b652fc28c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Returning 404 to user: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5a71333e-6a12-4a44-b06e-010b652fc28c tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795" status: 404 len: 109 microversion: 2.1 time: 0.076842 Aug 09 17:56:14.369823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 17:56:14 2022] GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:56:14.379719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-56c9aeef-0b54-40d3-80a4-58c105494374 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c08727670>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:14.430369 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-56c9aeef-0b54-40d3-80a4-58c105494374 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] HTTP exception thrown: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-56c9aeef-0b54-40d3-80a4-58c105494374 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Request method failure captured: Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 HTTP/1.1 Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p-wv58T50fAZxx78fhHJc86jGJBKzLsXf-7GLIiHRM7PV5tHsIOycE_HPy8MRX2Rpast3umt0ug_i1poItFRwLLgRjTkedAbxpmY3NHaFaMFz8R1eB5N44fTjal-tSZD5wCfRXCTWIc7ptXnU0YtCRVJm0XhfkrBZy9aQl4ynmdptI Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 17:56:14.433398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2d3d0d44ab748d5bcdc09452916b6bc", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 553aa53db51b4c8aaac26e81f0521f04 Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'f6f30e23-805a-4195-a9cd-194744df2795'} Aug 09 17:56:14.434592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. (HTTP 404) (Request-ID: req-3bb09c9d-1579-452e-b49f-2fd49377be6b) Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.435994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:56:14.437031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 17:56:14.437976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.439043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.440307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-56c9aeef-0b54-40d3-80a4-58c105494374 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Returning 404 to user: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:56:14.440976 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-56c9aeef-0b54-40d3-80a4-58c105494374 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795" status: 404 len: 109 microversion: 2.1 time: 0.066577 Aug 09 17:56:14.441849 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 17:56:14 2022] DELETE /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:56:14.452716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a578b18c-3bfb-4fd9-934f-757314c763b0 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Calling method '.version_select at 0x7f8c090981f0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:14.558918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-a578b18c-3bfb-4fd9-934f-757314c763b0 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] HTTP exception thrown: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a578b18c-3bfb-4fd9-934f-757314c763b0 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Request method failure captured: Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 HTTP/1.1 Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p-wv58T50fAZxx78fhHJc86jGJBKzLsXf-7GLIiHRM7PV5tHsIOycE_HPy8MRX2Rpast3umt0ug_i1poItFRwLLgRjTkedAbxpmY3NHaFaMFz8R1eB5N44fTjal-tSZD5wCfRXCTWIc7ptXnU0YtCRVJm0XhfkrBZy9aQl4ynmdptI Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 17:56:14.561318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2d3d0d44ab748d5bcdc09452916b6bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2d3d0d44ab748d5bcdc09452916b6bc", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: d2d3d0d44ab748d5bcdc09452916b6bc Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1085854810 Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 553aa53db51b4c8aaac26e81f0521f04 Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1085854810-project Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'f6f30e23-805a-4195-a9cd-194744df2795'} Aug 09 17:56:14.562648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. (HTTP 404) (Request-ID: req-6d177542-64ab-42dd-b7e9-bfdb9d842df9) Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.563452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:56:14.564317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 17:56:14.565186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a578b18c-3bfb-4fd9-934f-757314c763b0 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] Returning 404 to user: Volume f6f30e23-805a-4195-a9cd-194744df2795 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a578b18c-3bfb-4fd9-934f-757314c763b0 tempest-VolumesSnapshotsTestJSON-1085854810 tempest-VolumesSnapshotsTestJSON-1085854810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795" status: 404 len: 109 microversion: 2.1 time: 0.117094 Aug 09 17:56:14.566036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 9/18] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 17:56:14 2022] GET /compute/v2.1/os-volumes/f6f30e23-805a-4195-a9cd-194744df2795 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:56:14.765934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-69c25506-56d4-4168-b250-94da32179978 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'create', calling method: .version_select at 0x7f8c086a04c0>, body: {"keypair": {"name": "tempest-keypair-1071726028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCct9OIMGurBLlxti1Vrv7rPYdplBQvZzxI9ndI1UfVv/enZreoPzdhmqZidbb/3xOQ6BPRfY6GegQvoqiy/WcxB2721JqR4nQ6gnOE+UV5VCsjqVwCfhbahXTlmLHdIfg=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:14.855481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-69c25506-56d4-4168-b250-94da32179978 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for project 6816355a42d64d5988aff83532ff5888. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:14.873049 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-69c25506-56d4-4168-b250-94da32179978 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for user cb11c04acb4f40cd9d09edf16b11abb0 and project 6816355a42d64d5988aff83532ff5888. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:14.982485 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-69c25506-56d4-4168-b250-94da32179978 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.477951 Aug 09 17:56:14.983646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 10/19] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 17:56:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:56:19.933997 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-80d88d3a-7e05-4022-a8e5-40a3697d7975 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: .version_select at 0x7f8c086d7af0>, body: {"keypair": {"name": "tempest-keypair-1866948201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOYubj3uR3pygahS9ErCmXdB1H74MQoEWYvTRLO/kgBe6zX8YZdifJW72pYKl/zkkdNqOxWJvln0X7CeaEdanIZ9Gu+h+ApZJ6cJ6s2IUNW7scCvmziNb6tUTQgZdUbYg=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:20.075476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-80d88d3a-7e05-4022-a8e5-40a3697d7975 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:20.099083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-80d88d3a-7e05-4022-a8e5-40a3697d7975 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:20.262223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-80d88d3a-7e05-4022-a8e5-40a3697d7975 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.604409 Aug 09 17:56:20.279684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 17:56:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:21.375601 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2066310029", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:21.593524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] validate_networks() for [('76402604-ea92-4e64-a6a5-6720e8bdea8a', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:56:22.422063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-414607318", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "networks": [{"uuid": "b3c53afb-86b8-4bc3-b790-3e4034db3a5c"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:22.710205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] validate_networks() for [('b3c53afb-86b8-4bc3-b790-3e4034db3a5c', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:56:24.888289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:25.531768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:25.532198 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:25.532975 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:25.533800 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:25.534107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:25.563540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:25.564755 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:25.565671 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:25.569393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:25.570467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:25.574265 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:25.618222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for project 13cf0de2979c44a08f500430834617d2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:25.630917 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for user f7491479bd88425f8234e0b1d0e11e55 and project 13cf0de2979c44a08f500430834617d2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:25.662330 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:25.670323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:25.808082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b004ce5d-377f-4c6d-82e3-ce55ac0e9962 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.057317 Aug 09 17:56:25.811266 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 11/21] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:56:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 5061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:56:25.827174 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-403977452", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89185f52-f4e7-40d3-aaf9-79262f0a24c9"}], "security_groups": [{"name": "tempest-securitygroup--1595727590"}], "key_name": "tempest-keypair-1071726028", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:26.326011 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] validate_networks() for [('89185f52-f4e7-40d3-aaf9-79262f0a24c9', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:56:26.440505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:26.441056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:26.442132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:26.443088 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:26.443828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:26.494386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:26.497509 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:26.499592 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:26.500682 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:26.503244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:26.504208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:26.580007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Getting quotas for project dc7eada23fab4b428e8dd7be1738cea5. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:26.593312 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Getting quotas for user e18740d304014f8caa523b5d41500140 and project dc7eada23fab4b428e8dd7be1738cea5. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:26.634574 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:26.644711 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:26.903672 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67c98f58-505c-4397-a161-788e858bdf8c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.771914 Aug 09 17:56:26.911639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 11/22] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:56:27.407088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:27.407573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:27.407982 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:27.408395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:27.408948 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:27.434582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:27.435726 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:27.441814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:27.442736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:27.446052 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:27.446619 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:27.529419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for project 6816355a42d64d5988aff83532ff5888. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:27.537108 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for user cb11c04acb4f40cd9d09edf16b11abb0 and project 6816355a42d64d5988aff83532ff5888. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:27.570445 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:27.574189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:27.701210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5b2632e5-47f4-4de3-9ef8-b5a01f6642e1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.886696 Aug 09 17:56:27.704497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 12/23] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:56:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:56:27.711072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1d2414b-a448-4d5e-9f11-0b51e8a1be1c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:27.714271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1d2414b-a448-4d5e-9f11-0b51e8a1be1c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:27.744118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c9ec5583-dddd-4b1d-b41b-5a3613d2deef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'create', calling method: .version_select at 0x7f8c07d8fdc0>, body: {"keypair": {"name": "tempest-keypair-1472800528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUrxPsTPB7GCvRWSUVGUX4SrerHkgUhw8WKOnLfCKzXU7kjJ9gSBhHfkgiabHt8GuY0HX1JqLV9cz6QwMwmJw6dEEa8Rp646cg1H1tm4yXWtQ/2dsnKqHcz6Ny9RuacHA=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:27.792764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c9ec5583-dddd-4b1d-b41b-5a3613d2deef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for project 3b320e561ec5450682ed979963c392a0. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:27.814065 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c9ec5583-dddd-4b1d-b41b-5a3613d2deef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for user 18bf10b172e7450a9b618683643ed48e and project 3b320e561ec5450682ed979963c392a0. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:27.909723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c9ec5583-dddd-4b1d-b41b-5a3613d2deef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.999502 Aug 09 17:56:27.919622 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 12/24] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Aug 9 17:56:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1010 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:56:27.934924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-285420826", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f6bff3-89eb-4947-b35c-63d3a99a9190"}], "security_groups": [{"name": "tempest-securitygroup--734223950"}], "key_name": "tempest-keypair-1866948201", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:28.026374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1d2414b-a448-4d5e-9f11-0b51e8a1be1c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:28.063735 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d1d2414b-a448-4d5e-9f11-0b51e8a1be1c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1222 microversion: 2.1 time: 0.357728 Aug 09 17:56:28.072500 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 13/25] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:27 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1222 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:28.089779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7709ecb1-fe27-4eb8-adbc-747f16e07125 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:28.091499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7709ecb1-fe27-4eb8-adbc-747f16e07125 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:28.242578 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] validate_networks() for [('88f6bff3-89eb-4947-b35c-63d3a99a9190', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:56:28.326234 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7709ecb1-fe27-4eb8-adbc-747f16e07125 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:28.353953 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7709ecb1-fe27-4eb8-adbc-747f16e07125 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1214 microversion: 2.1 time: 0.280217 Aug 09 17:56:28.358379 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 14/26] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:28 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:28.377520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b383c14e-669c-4161-8e80-81e9b8d32c26 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:28.380757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b383c14e-669c-4161-8e80-81e9b8d32c26 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:28.564966 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b383c14e-669c-4161-8e80-81e9b8d32c26 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:28.577134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b383c14e-669c-4161-8e80-81e9b8d32c26 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1237 microversion: 2.1 time: 0.212349 Aug 09 17:56:28.579615 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 15/27] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:28 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1237 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:28.589886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1891182888", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:28.741828 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] validate_networks() for [('76402604-ea92-4e64-a6a5-6720e8bdea8a', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:56:29.469660 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:29.470652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:29.471361 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:29.472408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:29.473396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:29.491527 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.494154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.495520 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.497556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.508632 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.509512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.554053 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:29.560275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:29.582571 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:29.585416 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:29.626944 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:29.627654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:29.628240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:29.629841 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:29.630563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:29.642363 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.642858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.643326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.644049 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.647648 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.649591 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.679376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for project 13cf0de2979c44a08f500430834617d2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:29.688073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2bd5968-0cc6-4f8a-bd5a-2ac7d4687f1e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.766173 Aug 09 17:56:29.688364 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for user f7491479bd88425f8234e0b1d0e11e55 and project 13cf0de2979c44a08f500430834617d2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:29.690410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 13/28] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:56:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:56:29.700957 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:29.701595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:29.710769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:29.713505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:29.742148 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.742737 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.743246 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.743972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.744447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.744971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.813314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b7fb9f2b-6ea4-4c40-903c-8a47c22a2e9c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.229371 Aug 09 17:56:29.816750 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 16/29] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:56:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:56:29.829218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:29.830858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:29.850351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.851291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.852772 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.853510 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.853980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.854693 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:30.090476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:30.123024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-77a865a1-443b-4322-b76b-2e9d9a559c40 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1218 microversion: 2.1 time: 0.431506 Aug 09 17:56:30.123621 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 14/30] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:29 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1218 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:30.139029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2330b7ab-8d36-48de-a35d-43f6d7c85021 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:30.139669 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2330b7ab-8d36-48de-a35d-43f6d7c85021 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:30.181217 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:30.210086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-315fe168-a425-45bb-8ba9-ce32d760ed9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1241 microversion: 2.1 time: 0.387791 Aug 09 17:56:30.213394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 17/31] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:29 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1241 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:30.249619 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8a490f2f-36aa-4f6f-8a51-58ad2e3306c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:30.252718 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2330b7ab-8d36-48de-a35d-43f6d7c85021 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:30.256989 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8a490f2f-36aa-4f6f-8a51-58ad2e3306c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:30.302152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2330b7ab-8d36-48de-a35d-43f6d7c85021 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1241 microversion: 2.1 time: 0.172812 Aug 09 17:56:30.303867 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 15/32] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:30 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:30.394885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8a490f2f-36aa-4f6f-8a51-58ad2e3306c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:30.411684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8a490f2f-36aa-4f6f-8a51-58ad2e3306c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1222 microversion: 2.1 time: 0.180902 Aug 09 17:56:30.412569 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 18/33] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:30 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1222 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:30.539301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1679287016", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6247f242-ae61-4c03-a0d7-0070d194bcfa"}], "security_groups": [{"name": "tempest-securitygroup--1246897238"}], "key_name": "tempest-keypair-1472800528", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:30.677034 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] validate_networks() for [('6247f242-ae61-4c03-a0d7-0070d194bcfa', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:56:31.147797 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:31.148627 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:31.157454 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.159727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.160747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.166436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.167106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.167852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.352608 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:31.390065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2a3cefd0-a723-4109-b618-e9008a393e66 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1218 microversion: 2.1 time: 0.242383 Aug 09 17:56:31.407498 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 19/34] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:31 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1218 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:31.416862 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:31.417621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:31.429794 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.434217 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.436086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.438673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.439936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.440570 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.464511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:31.465475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:31.465969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:31.466573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:31.468810 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:31.485609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.486230 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.487003 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.488131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.490421 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.491064 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.549349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for project 3b320e561ec5450682ed979963c392a0. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:31.566357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for user 18bf10b172e7450a9b618683643ed48e and project 3b320e561ec5450682ed979963c392a0. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:31.594401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:31.613668 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0062e65d-298c-45b2-943b-9c471f66a305 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1233 microversion: 2.1 time: 0.204294 Aug 09 17:56:31.617492 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:31.618259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 20/35] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:31 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1233 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:31.636722 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:31.637946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:31.639761 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:31.666697 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.667714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.667714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.670035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.672221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.672705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.763075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4fb2608e-6a87-43b8-b62e-c115d4af51db tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.227165 Aug 09 17:56:31.773018 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 16/36] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Aug 9 17:56:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:56:31.782664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:31.783314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:31.804240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:31.813838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8752188e-7618-4fc4-9977-7ce4ff12e114 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1237 microversion: 2.1 time: 0.189885 Aug 09 17:56:31.814705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 21/37] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:31 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1237 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:31.820803 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-63ddbf5c-c513-4ce2-86fa-455ff27ff740 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:31.821608 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-63ddbf5c-c513-4ce2-86fa-455ff27ff740 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:31.837077 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.837570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.838109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.844682 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.846091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.847870 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.960961 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-63ddbf5c-c513-4ce2-86fa-455ff27ff740 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:31.978523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-63ddbf5c-c513-4ce2-86fa-455ff27ff740 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:31.980116 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-63ddbf5c-c513-4ce2-86fa-455ff27ff740 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:31.989720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-63ddbf5c-c513-4ce2-86fa-455ff27ff740 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1282 microversion: 2.20 time: 0.173491 Aug 09 17:56:31.990320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 22/38] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:31 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:32.048812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:32.060231 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c8931940-02d2-497f-95ef-5f54cfbb7662 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1218 microversion: 2.1 time: 0.284285 Aug 09 17:56:32.061494 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 17/39] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:31 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1218 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:32.413955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:32.414642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:32.431819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.432502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.432970 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:32.433752 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.434222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.434679 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:32.640816 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:32.643404 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:32.662463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.663122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.663589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:32.664334 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.668508 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.668935 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:32.689653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:32.699947 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dabb8a66-3070-48e3-b99f-17476787be9f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1266 microversion: 2.1 time: 0.289486 Aug 09 17:56:32.714739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 23/40] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:32 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:32.841069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:32.841707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:32.857253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.858014 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.858474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:32.859233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.862602 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:32.877394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-457eb04c-3eec-47c9-9891-6c7141dec3bc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1297 microversion: 2.1 time: 0.241339 Aug 09 17:56:32.878300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 18/41] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:32 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1297 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:32.878595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.879402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.014532 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:33.015562 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:33.016200 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:33.025564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-723b90b5-64c6-41d0-94fd-fa725805e112 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1293 microversion: 2.1 time: 0.189023 Aug 09 17:56:33.031767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 24/42] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:32 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1293 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:33.033023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.033586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.033972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.051294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.052970 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.054630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.087315 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:33.087945 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:33.105125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.107071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.108706 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.111116 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.112465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.114105 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.203986 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:33.217923 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:33.224066 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:33.226463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-33924f04-23c9-45f0-82f1-56bf8b5fa3cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1286 microversion: 2.20 time: 0.216756 Aug 09 17:56:33.228332 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 19/43] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:33 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1286 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:56:33.275472 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:33.286779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a128ce8b-b2a5-44ef-9926-6d8db1186d5b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1274 microversion: 2.1 time: 0.205477 Aug 09 17:56:33.299652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 25/44] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:33 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:33.741683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:33.742913 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:33.760950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.764607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.767394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.768841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.770874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.771552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.900831 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:33.903557 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:33.913245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.915434 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.916035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.919469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.920910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.923985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.016623 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.032604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-294258f4-32cb-4809-9e2a-9aaa6b269e3a tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1284 microversion: 2.1 time: 0.294550 Aug 09 17:56:34.033234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 20/45] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:33 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1284 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:34.054872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:34.055530 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:34.068671 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:34.069443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:34.070200 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.071161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:34.072424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:34.073632 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.095066 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.110904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5439ec32-794c-4b45-b0a7-1dca3e99d0ee tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1295 microversion: 2.1 time: 0.212644 Aug 09 17:56:34.119137 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 26/46] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:33 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1295 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:34.256194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:34.257134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:34.261529 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:34.278689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:34.279559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:34.280141 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.286056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:34.286526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:34.287348 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.390140 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.402361 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e24dfd81-6700-4ba6-8d08-7197896b631c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1311 microversion: 2.1 time: 0.352440 Aug 09 17:56:34.404459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 21/47] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:34 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1311 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:34.414053 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:34.417290 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:34.433373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:34.434448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:34.436334 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.437083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:34.437557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:34.437988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.531531 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.545103 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.550275 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.552812 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8373baac-10b2-4391-903b-5fed74c4294e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1334 microversion: 2.20 time: 0.302117 Aug 09 17:56:34.559027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 27/48] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:34 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1334 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:34.595871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.611695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e825fa2d-98fd-43b2-b43e-8d3803d5e9fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1280 microversion: 2.1 time: 0.205943 Aug 09 17:56:34.612607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 22/49] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:34 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:35.112264 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:35.122694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:35.141595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:35.142883 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.143210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:35.144159 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.145253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.147636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.150177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.152112 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.169799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.175511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.177013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.193369 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.198465 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.199465 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.581429 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:35.613728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2487e6cc-176a-423c-9687-801584d260b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1272 microversion: 2.1 time: 0.544855 Aug 09 17:56:35.618262 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 28/50] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:35 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1272 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:35.642770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:35.651804 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:35.663405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.664060 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.664593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.666853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.667495 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.669502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.757790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:35.766327 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a4549ec-7de2-4102-a3e2-6b9ec06ef403 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1295 microversion: 2.1 time: 0.632365 Aug 09 17:56:35.766966 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 23/51] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:35 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1295 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:35.771866 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:35.772476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:35.784693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.795882 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.796620 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.797565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.798193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.799008 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.915606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:35.925304 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7161c9ca-95de-4fcb-bfcb-7191322c00ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1299 microversion: 2.1 time: 0.305919 Aug 09 17:56:35.927651 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 29/52] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:35 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:35.942926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:35.943891 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:35.952749 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.956982 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.957708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.958660 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.959317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.963744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:36.045542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:36.057968 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:36.060723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:36.068452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1f9f02ba-ee32-479f-8136-30084eb62f1c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1340 microversion: 2.20 time: 0.300242 Aug 09 17:56:36.069343 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 24/53] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:35 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1340 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:36.242798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:36.257747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1162faff-094b-4401-b4e2-a1818efd3b4c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1280 microversion: 2.1 time: 0.321412 Aug 09 17:56:36.258457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 30/54] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:35 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:36.644492 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:36.645086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:36.653794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:36.694170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.695364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.708852 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:36.713073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.717630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.718151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:36.793882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:36.794759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:36.807073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.809606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.812394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:36.815175 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.815825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.817274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:37.884398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:37.897489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bce81d79-369c-4e3d-b26c-7fc2ab242578 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1295 microversion: 2.1 time: 1.111623 Aug 09 17:56:37.900685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 31/55] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:36 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1295 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:37.905991 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:37.906606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:37.933337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:37.934165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:37.934811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:37.935850 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:37.936497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:37.937138 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:38.121547 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:38.137453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8468a7b7-96db-466f-afff-cba88b3804c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1299 microversion: 2.1 time: 0.233406 Aug 09 17:56:38.143803 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 32/56] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:37 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:38.162568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:38.175790 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:38.202882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.216606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.223257 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:38.225605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.228531 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.228989 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:38.485357 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:38.505409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:38.508795 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:38.515640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bbb96f2c-77b1-4b0f-97ef-0ae3f7ef4efe tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1340 microversion: 2.20 time: 0.367138 Aug 09 17:56:38.520965 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 33/57] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:38 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1340 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:38.537500 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:38.538620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:38.565266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:38.586822 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.590903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.591660 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:38.593023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-29c35e43-6689-43b8-b09c-117411ab29a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 1.946588 Aug 09 17:56:38.593732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 25/58] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:36 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:38.595146 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.595755 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.598678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:38.646824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:38.928615 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:38.930311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:38.954383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.954877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.955380 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:38.956115 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.956544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.957038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:39.670482 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:39.797341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:39.805554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6ca23e0e-1918-4666-9be8-e59797066257 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 1.283187 Aug 09 17:56:39.830189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 34/59] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:38 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:39.839466 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:39.843437 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:39.866127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:39.867144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:39.867874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:39.868978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:39.869785 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:39.870621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:40.135427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:40.169700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e71696f4-cd64-48aa-9890-aad11266be2d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1299 microversion: 2.1 time: 0.337889 Aug 09 17:56:40.170605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 35/60] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:39 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1299 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:40.182403 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:40.183349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:40.206389 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:40.207254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:40.207929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:40.211093 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:40.211776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:40.212405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:40.252866 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:40.265075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67b98b6d-9eca-476d-be1f-f401d96c3c53 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 1.341625 Aug 09 17:56:40.282469 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 26/61] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:38 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:40.296807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:40.297790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:40.313971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:40.314706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:40.315405 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:40.316385 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:40.317069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:40.317676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:41.515280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:41.602848 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=28 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:41.864161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:41.893023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b6656e4d-5a39-4d74-9086-b0a2c22c9094 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 1.605800 Aug 09 17:56:41.895288 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 27/62] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:40 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:41.913765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:41.917616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:41.941893 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:41.946223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:41.947987 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:41.948928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:41.951390 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:41.951993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:41.965394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=28 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:42.456161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:42.480236 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:42.484673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:42.489949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3e9f4313-5668-4eae-9b51-62acd306ec34 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 2.317585 Aug 09 17:56:42.490048 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 36/63] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:40 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:42.514048 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:42.519589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:42.541984 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:42.547766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:42.548229 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:42.549808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:42.550279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:42.550713 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:43.501065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:43.505984 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:43.542017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d60b14d5-a05b-4190-b4af-f9600c7b1f42 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 1.042992 Aug 09 17:56:43.545244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-93260645-2576-49b9-a59a-f59326358f04 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 1.647324 Aug 09 17:56:43.565808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 37/64] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:42 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:43.571352 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 28/65] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:41 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:43.580122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:43.587184 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:43.588238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:43.589221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:43.602658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:43.609493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:43.610361 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:43.611088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:43.611795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:43.612441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:43.613402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:43.614322 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:43.615485 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:43.618212 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:43.619069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:43.619871 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:44.329904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:44.340529 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a23608fe-fbab-47f9-9aac-b26cd7e8388d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.772098 Aug 09 17:56:44.344935 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 38/66] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:43 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:44.414793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:44.422034 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:44.453208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:44.455566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:44.460516 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:44.463816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:44.471435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:44.475940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:44.935339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:44.988250 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dfe1ef71-d8b1-4661-af0d-cf0c7fcfd9a1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 1.415423 Aug 09 17:56:45.004992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 29/67] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:43 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:45.018641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:45.019603 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:45.029487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:45.030341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:45.031173 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:45.032996 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:45.033714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:45.034350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:45.737851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:45.760340 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:45.763335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:45.764975 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f286e553-c1d1-4958-8cd1-a1b2c1aca05b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 1.418774 Aug 09 17:56:45.765792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 39/68] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:44 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:45.781768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:45.783231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:45.798501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:45.799289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:45.800469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:45.803646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:45.805162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:45.807004 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:45.874302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:45.897162 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-052d4e36-1d30-4971-87d0-f0a964bcd122 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.890436 Aug 09 17:56:45.903812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 30/69] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:45 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:46.298533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-f4319350-66ce-4a63-b3df-ed436940b953 req-07d8b78c-44ba-4404-9838-2ff600da0b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c49d1e42-20f2-496b-bf4b-14348388eccb", "tag": "37180717-0671-42b4-a508-b367fca29a06"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:46.317876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f4319350-66ce-4a63-b3df-ed436940b953 req-07d8b78c-44ba-4404-9838-2ff600da0b8c service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:46.318830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f4319350-66ce-4a63-b3df-ed436940b953 req-07d8b78c-44ba-4404-9838-2ff600da0b8c service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:46.320081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f4319350-66ce-4a63-b3df-ed436940b953 req-07d8b78c-44ba-4404-9838-2ff600da0b8c service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:46.367147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-f4319350-66ce-4a63-b3df-ed436940b953 req-07d8b78c-44ba-4404-9838-2ff600da0b8c service nova] Creating event network-changed:37180717-0671-42b4-a508-b367fca29a06 for instance c49d1e42-20f2-496b-bf4b-14348388eccb on hv-cinder-83608 Aug 09 17:56:46.368523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f4319350-66ce-4a63-b3df-ed436940b953 req-07d8b78c-44ba-4404-9838-2ff600da0b8c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:56:46.369956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f4319350-66ce-4a63-b3df-ed436940b953 req-07d8b78c-44ba-4404-9838-2ff600da0b8c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:56:46.371944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:46.372888 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:46.373763 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:46.374712 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:46.375454 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:46.376451 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:46.387633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:46.397917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.compute.rpcapi [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 17:56:46.399829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] Releasing lock "compute-rpcapi-router" {{(pid=117885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:56:46.438058 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-78d43fef-2644-4a14-a3e4-8d0440a10385 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.527095 Aug 09 17:56:46.439768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 31/70] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:46.446836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:46.448119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:46.461157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:46.463690 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:46.464613 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:46.465739 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:46.466546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:46.467573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:47.180867 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:47.193793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a43b347a-66ef-455f-a18e-99f563978a7f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 1.426167 Aug 09 17:56:47.194401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 40/71] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:45 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:47.207397 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:47.211223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:47.234502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:47.236136 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:47.238515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:47.241692 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:47.243003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:47.245303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.029741 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.039774 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.051986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a6488a1f-3c24-41aa-9419-9fdd6a09d646 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.854407 Aug 09 17:56:48.055421 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e670d27c-2667-4168-af68-77c131a62d8d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 1.613922 Aug 09 17:56:48.075978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 41/72] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:47 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:48.077989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 32/73] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:46 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:48.096723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:48.097357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:48.100693 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:48.101305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:48.121180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.121180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.121589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.122563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.124347 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.124842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.125262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.125962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.126409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.126827 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.131172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.131711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.482657 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.484424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.493028 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c1db1704-0407-4c89-81c5-511c5b427b4c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.413772 Aug 09 17:56:48.507820 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 33/74] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:48 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:48.517346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.519833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.520973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5757075c-cc2d-452b-874a-71bbc65a8e45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.443332 Aug 09 17:56:48.521539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 42/75] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:48 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:48.534773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:48.545691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:48.562727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.567430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.567904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.570587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.574253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.575301 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.744853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-6230323d-bb39-4563-bd8e-98b7ff318fd9 req-e2c8ec61-661e-4167-bd3d-cbb15da81639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa4777f-70e1-491f-9595-5e72966cddb9", "tag": "664a7e59-c2d6-45f3-bd6d-0efea18ceb4f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:48.757625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6230323d-bb39-4563-bd8e-98b7ff318fd9 req-e2c8ec61-661e-4167-bd3d-cbb15da81639 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.758538 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6230323d-bb39-4563-bd8e-98b7ff318fd9 req-e2c8ec61-661e-4167-bd3d-cbb15da81639 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.759427 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6230323d-bb39-4563-bd8e-98b7ff318fd9 req-e2c8ec61-661e-4167-bd3d-cbb15da81639 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.773767 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-6230323d-bb39-4563-bd8e-98b7ff318fd9 req-e2c8ec61-661e-4167-bd3d-cbb15da81639 service nova] Creating event network-changed:664a7e59-c2d6-45f3-bd6d-0efea18ceb4f for instance 9fa4777f-70e1-491f-9595-5e72966cddb9 on hv-cinder-83608 Aug 09 17:56:48.781466 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-6230323d-bb39-4563-bd8e-98b7ff318fd9 req-e2c8ec61-661e-4167-bd3d-cbb15da81639 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282590 Aug 09 17:56:48.782958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 34/76] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:48.790517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e743b93-99bc-4ef2-884d-7511bce8415f", "tag": "a18f1e80-b9c2-4442-8d36-e8cfff384bc4"}, {"name": "network-changed", "server_uuid": "ffe8c172-bab3-4a24-b716-1b536176ef81", "tag": "9fa650be-eba1-4201-8c24-eb7b2ec8a90a"}, {"name": "network-changed", "server_uuid": "6fc776d4-095b-4bbc-89a9-b99528a089f3", "tag": "ccbb0e01-18a7-497b-830d-11366e7d9e61"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:48.805650 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:48.807263 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:48.809029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:48.832962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] Creating event network-changed:a18f1e80-b9c2-4442-8d36-e8cfff384bc4 for instance 4e743b93-99bc-4ef2-884d-7511bce8415f on hv-cinder-83608 Aug 09 17:56:48.833875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] Creating event network-changed:9fa650be-eba1-4201-8c24-eb7b2ec8a90a for instance ffe8c172-bab3-4a24-b716-1b536176ef81 on hv-cinder-83608 Aug 09 17:56:48.834321 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] Creating event network-changed:ccbb0e01-18a7-497b-830d-11366e7d9e61 for instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 on hv-cinder-83608 Aug 09 17:56:48.845807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-4514b7bf-a78e-4850-bb7c-168d61c1f4c4 req-453a80c6-f146-46a1-9b34-33e351dbb80b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.061185 Aug 09 17:56:48.846563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 35/77] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:48.975100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.984528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-698a78bc-8774-44a1-bf8a-b22aaee5c521 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.457947 Aug 09 17:56:48.985199 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 43/78] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:48 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:49.078258 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:49.084079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:49.084871 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:49.088627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:49.095463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.095942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.099484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.099971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.100403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.101089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.101647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.101945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.106445 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.107295 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.107701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.108133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.314096 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:49.322543 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-62833eb3-36ab-4b59-8880-3c7da8fdbb02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.242548 Aug 09 17:56:49.323395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 44/79] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:49 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:49.336963 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:49.345884 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d4bf6f7-ff1f-4f3f-a07c-36d608fc8068 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.272180 Aug 09 17:56:49.346697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 36/80] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:49 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:49.522942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:49.528122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:49.535759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.536256 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.536694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.537401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.537881 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.538472 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.544795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:49.545645 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:49.551869 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.552556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.553152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.553843 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.554282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.554845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.818705 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:49.820595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:49.829961 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:49.832440 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:49.833586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1d6e690e-b685-46c9-8c0a-9cfde75e0ff3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.293283 Aug 09 17:56:49.834531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 37/81] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:49 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:49.842585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-21c4b80c-69d3-4884-aa1d-434d8f168a44 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.332045 Aug 09 17:56:49.844142 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 45/82] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:49 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:50.009510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:50.010209 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:50.018479 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.019066 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.020288 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.021653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.022187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.022845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.348978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:50.349991 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:50.359126 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.359923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.360768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.362063 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.362932 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.374575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.611568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:50.624326 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-803d9172-fd4e-4f12-9dff-85f14291f805 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.622326 Aug 09 17:56:50.625554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 38/83] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:50 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:50.633449 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:50.634316 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:50.644364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.645654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.649382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.650652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.653293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.653800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.814363 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:50.822648 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7cfb35f7-0a16-41ea-8fcc-d1988ec95b1e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.480598 Aug 09 17:56:50.823271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 46/84] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:50 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:50.838001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-82473bd2-24c2-468a-9434-9cdb48cbd6d9 req-a7d3350d-3c5e-4962-b210-7cf463a316f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbe1d82-6292-4a15-a16f-d0523a939fe7", "tag": "c2bfe46e-68c0-434d-be2c-a2ea6aaac310"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:50.853533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-82473bd2-24c2-468a-9434-9cdb48cbd6d9 req-a7d3350d-3c5e-4962-b210-7cf463a316f2 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.854024 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-82473bd2-24c2-468a-9434-9cdb48cbd6d9 req-a7d3350d-3c5e-4962-b210-7cf463a316f2 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.854419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-82473bd2-24c2-468a-9434-9cdb48cbd6d9 req-a7d3350d-3c5e-4962-b210-7cf463a316f2 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.880129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-82473bd2-24c2-468a-9434-9cdb48cbd6d9 req-a7d3350d-3c5e-4962-b210-7cf463a316f2 service nova] Creating event network-changed:c2bfe46e-68c0-434d-be2c-a2ea6aaac310 for instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 on hv-cinder-83608 Aug 09 17:56:50.880664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-82473bd2-24c2-468a-9434-9cdb48cbd6d9 req-a7d3350d-3c5e-4962-b210-7cf463a316f2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:56:50.881060 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-82473bd2-24c2-468a-9434-9cdb48cbd6d9 req-a7d3350d-3c5e-4962-b210-7cf463a316f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:56:50.884193 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.885634 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.887954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.889542 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.890152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.892504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.894252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:50.904063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4f4b74ae-1707-498f-9a9b-4927a684df1f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.276675 Aug 09 17:56:50.906580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.compute.rpcapi [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 17:56:50.907906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7221502-9aa6-481b-a495-38f973448409 None None] Releasing lock "compute-rpcapi-router" {{(pid=117886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:56:50.915717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 39/85] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:50 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:50.927419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b7221502-9aa6-481b-a495-38f973448409 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098421 Aug 09 17:56:50.928033 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 47/86] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:50.930043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:50.930646 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:50.936014 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:50.936713 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:50.939096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.939749 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.940364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.941472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.942553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.943029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.943823 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.944452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.944895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.945591 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.946401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.947107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.230027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:51.242337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bed94039-ce5d-4399-b028-d835d10da10c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.324435 Aug 09 17:56:51.242962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 40/87] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:50 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:51.296406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:51.321902 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:51.325053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:51.332786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e0e26614-2b1d-45a6-98be-55b244429f27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.398558 Aug 09 17:56:51.334646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 48/88] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:50 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:51.648342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:51.651519 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:51.662457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.663006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.663566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.664201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.664871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.665658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.850671 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:51.853521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:51.868092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.868776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.869362 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.870373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.871024 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.871659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.892672 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:51.905445 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-edc9e7e4-51d9-47da-bef6-afc7279ed9f5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.262460 Aug 09 17:56:51.920727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 41/89] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:51 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:51.926414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:51.927788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:51.937557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.938297 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.938922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.939637 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.940103 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.940958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:52.292597 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:52.301406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3ea7a463-0154-4d5a-8877-1086730e880e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.379050 Aug 09 17:56:52.304424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:52.305536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 42/90] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:51 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:52.317060 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:52.318029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:52.326266 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b3236115-598b-44f1-a092-594337cad059 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.484588 Aug 09 17:56:52.331814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 49/91] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:51 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:52.334236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:52.334748 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:52.336495 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:52.337415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:52.338179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:52.338673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:52.360400 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:52.361380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:52.378707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:52.379549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:52.380202 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:52.381137 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:52.381778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:52.382395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:52.929732 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:52.940654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:52.942463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:52.943858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5e167303-3d79-4cb2-a31b-619183ede821 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.588067 Aug 09 17:56:52.961974 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 50/92] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:52 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:56:52.968132 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:52.969001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:52.980060 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:52.980814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:52.981505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:52.983545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:52.984260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:52.984886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:53.013296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:53.048207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:53.069149 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1eec525e-cbd7-472e-9cbb-c5ecc7877b01 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.756262 Aug 09 17:56:53.078998 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 43/93] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:52 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:53.219923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:53.227504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-396478a2-706d-49ca-803a-a5e6bec0201c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.264320 Aug 09 17:56:53.228279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 51/94] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:52 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:53.333410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:53.334568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:53.348972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:53.349473 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:53.349917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:53.350759 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:53.351264 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:53.351691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:53.354513 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:53.355410 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:53.368151 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:53.368894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:53.369796 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:53.370518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:53.371029 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:53.371466 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:53.609453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:53.616037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:53.619029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-00f5113a-d058-48f9-9200-af8be8bf93d1 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.296861 Aug 09 17:56:53.620497 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 44/95] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:53 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:53.637764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-623e0778-3ad6-4818-ae14-8fb454ffecb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.288985 Aug 09 17:56:53.646939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 52/96] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:53 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:53.972282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:53.972916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:53.985234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:53.985904 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:53.986350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:53.987892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:53.988841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:53.989572 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:54.097659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:54.098388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:54.107670 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:54.108519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:54.109262 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:54.110328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:54.111024 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:54.111687 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:54.322354 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:54.343686 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:54.345744 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:54.349689 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0e766afd-8d58-4afb-a4b1-f8da2d470c91 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.381443 Aug 09 17:56:54.350723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 45/97] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:53 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:54.378163 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:54.378807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:54.391056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:54.393991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:54.395315 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:54.398652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:54.400873 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:54.401521 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:54.430816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:54.440430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-287a44f7-4aea-4b4c-8b7e-71e3937054d0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.347522 Aug 09 17:56:54.441357 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 53/98] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:54 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:54.642336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:54.643146 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:54.654189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:54.658068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:54.658640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:54.661714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:54.663037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:54.664767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.152064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:55.162824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7e1b5a68-3435-409d-8c34-529635cc7388 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.522521 Aug 09 17:56:55.164645 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 54/99] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:54 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:55.170678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:55.171338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:55.201933 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:55.203200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.203711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.204153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.206200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.208871 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.209904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.217381 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-86002d86-7da8-4f52-8394-fa280784d164 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.865123 Aug 09 17:56:55.218571 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 46/100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:54 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:55.502419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b349cb61-2085-4033-b57c-1c77a10671bf req-bf28db90-ef9e-4a2e-830b-6352d45f006f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49d1e42-20f2-496b-bf4b-14348388eccb", "name": "network-vif-plugged", "status": "completed", "tag": "37180717-0671-42b4-a508-b367fca29a06"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:55.514096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b349cb61-2085-4033-b57c-1c77a10671bf req-bf28db90-ef9e-4a2e-830b-6352d45f006f service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.514928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b349cb61-2085-4033-b57c-1c77a10671bf req-bf28db90-ef9e-4a2e-830b-6352d45f006f service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.515822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b349cb61-2085-4033-b57c-1c77a10671bf req-bf28db90-ef9e-4a2e-830b-6352d45f006f service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.535919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:55.546637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f23fda95-da00-42c0-99dd-7daf2e621aa5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.380512 Aug 09 17:56:55.549131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 55/101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:55 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:55.556897 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b349cb61-2085-4033-b57c-1c77a10671bf req-bf28db90-ef9e-4a2e-830b-6352d45f006f service nova] Creating event network-vif-plugged:37180717-0671-42b4-a508-b367fca29a06 for instance c49d1e42-20f2-496b-bf4b-14348388eccb on hv-cinder-83608 Aug 09 17:56:55.557814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:55.558775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:55.568461 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b349cb61-2085-4033-b57c-1c77a10671bf req-bf28db90-ef9e-4a2e-830b-6352d45f006f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309235 Aug 09 17:56:55.570007 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.570793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.572321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.573466 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.574200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.575001 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 47/102] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:55.575593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.585753 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:55.590314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:55.605254 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.609001 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.609673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.610613 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.612517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.613166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.897370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:55.910117 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:55.911877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:55.913291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-68703d9e-6076-4e2c-935e-e6a534ddc5f0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.362814 Aug 09 17:56:55.917097 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 56/103] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:55 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:55.967142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:55.986511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-aab791b8-ccea-41de-967b-7eef7454cdf6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.409284 Aug 09 17:56:55.992732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 48/104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:55 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:56.185870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:56.186490 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:56.201317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:56.202051 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:56.202676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:56.203640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:56.204277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:56.204884 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:56.241213 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:56.242136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:56.265108 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:56.266049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:56.268092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:56.269029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:56.273196 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:56.273942 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:56.388025 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:56.820224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:56.842120 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-91e2c6e6-af4a-4b43-b753-75b5e82222cb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.605572 Aug 09 17:56:56.856249 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 49/105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:56 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:56.862065 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:56.863408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:56.878141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:56.878798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:56.879434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:56.880291 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:56.880996 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:56.881572 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:56.920704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:56.937279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:56.946478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-285d1be3-0474-49d2-870a-71a6508e5a59 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.764659 Aug 09 17:56:56.956231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 57/106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:56 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:56.999475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:57.003133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:57.019665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.022166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.024662 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:57.025721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.027815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.028412 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:57.181474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:57.194839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-71e896ba-a51f-43c8-ab5c-8b7c121d47b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.334844 Aug 09 17:56:57.195689 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 50/107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:56 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:57.205303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:57.207450 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:57.220376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.226202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.226988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:57.227922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.228563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.229202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:57.439260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:57.452484 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:57.460124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:57.462611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-465b13e3-a724-430e-a73f-726c48dec0ad tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.489033 Aug 09 17:56:57.465332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 58/108] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:56 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:56:57.484532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:57.492723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-70bd5184-6605-4883-9995-cd59fff41395 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.295415 Aug 09 17:56:57.493456 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 51/109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:57 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:57.863411 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:57.864104 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:57.874289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.875091 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.876523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:57.877632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.880649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.881262 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:57.972986 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:57.974285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:57.981427 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.981922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.982364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:57.983432 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:57.983888 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:57.984468 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:58.066513 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:58.076319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-06b59f4a-083a-4598-b09b-833fe7e412c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.216973 Aug 09 17:56:58.077499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 59/110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:57 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:58.135676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:58.143445 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f467abaa-a96a-48e9-b33d-46cf712da159 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.174891 Aug 09 17:56:58.144027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 52/111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:57 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:58.220226 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:58.220836 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:58.226891 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:58.227419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:58.227838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:58.228525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:58.228980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:58.229413 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:58.370357 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:58.378558 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-33326755-3413-4312-b21d-b839d91af43f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.162076 Aug 09 17:56:58.379499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 60/112] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:58 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:58.491367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:58.491974 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:58.498835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:58.499409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:58.499837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:58.500699 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:58.501146 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:58.501556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:58.515899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:58.516514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:58.528376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:58.529089 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:58.530028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:58.533316 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:58.533956 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:58.534544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:58.897594 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:58.908283 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:58.911302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:58.913824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:58.915175 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c5263179-a5d6-4690-b344-edc3adc8419d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.427557 Aug 09 17:56:58.918254 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 53/113] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:58 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:56:58.936119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-9d601a45-18e6-4415-85e0-987d70c90211 req-296bdbb6-c318-4769-8539-f526fd0e15af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa4777f-70e1-491f-9595-5e72966cddb9", "name": "network-vif-plugged", "status": "completed", "tag": "664a7e59-c2d6-45f3-bd6d-0efea18ceb4f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:58.940272 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ab2fd538-b543-459a-95de-6d81481535e0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.428492 Aug 09 17:56:58.941816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 61/114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:58 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:58.948884 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-9d601a45-18e6-4415-85e0-987d70c90211 req-296bdbb6-c318-4769-8539-f526fd0e15af service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:58.978204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-9d601a45-18e6-4415-85e0-987d70c90211 req-296bdbb6-c318-4769-8539-f526fd0e15af service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:58.980019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-9d601a45-18e6-4415-85e0-987d70c90211 req-296bdbb6-c318-4769-8539-f526fd0e15af service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.000929 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-9d601a45-18e6-4415-85e0-987d70c90211 req-296bdbb6-c318-4769-8539-f526fd0e15af service nova] Creating event network-vif-plugged:664a7e59-c2d6-45f3-bd6d-0efea18ceb4f for instance 9fa4777f-70e1-491f-9595-5e72966cddb9 on hv-cinder-83608 Aug 09 17:56:59.007639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-9d601a45-18e6-4415-85e0-987d70c90211 req-296bdbb6-c318-4769-8539-f526fd0e15af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087216 Aug 09 17:56:59.008477 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 54/115] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:59.102591 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:59.103314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:59.117073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.117749 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.120166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.121110 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.123570 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.124015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.166169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:59.167033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:59.183422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.188068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.190955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.193564 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.194137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.195759 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.440696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:59.457209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb38339e-0174-47f6-bac1-16e36da7d68e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.359171 Aug 09 17:56:59.458571 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 62/116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:59 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:59.485056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:59.491865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:59.508153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.509038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.510733 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.518640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.523567 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.524271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.638626 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:59.648432 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-42d11897-ace9-46bc-9e91-b54c2350fc63 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.485566 Aug 09 17:56:59.649319 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 55/117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:59 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:59.706030 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:59.713414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-03d4f95f-10d3-4019-bbfd-68d59180d045 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.253026 Aug 09 17:56:59.714100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 63/118] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:59 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:59.944186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:59.944794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:59.950796 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.951305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.951747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.952433 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.952879 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.953349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.960819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:59.961436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:59.967996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.968480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.968913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:59.969605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:59.970054 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:59.970511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:00.148692 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:00.156137 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:00.157913 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:00.159522 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:00.160687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b37997bd-6682-401c-a0f5-7ad35ceecb6d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.220426 Aug 09 17:57:00.161255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 56/119] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:56:59 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:00.163990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-38094670-1dbc-4e21-8671-6c6198d62939 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.206927 Aug 09 17:57:00.164548 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 64/120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:59 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:00.482800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:00.483511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:00.489740 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:00.490238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:00.490664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:00.491434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:00.491878 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:00.492295 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:00.624025 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:00.631294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ad13ad3c-eb52-4f00-91d8-91fc8726e7ac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.152278 Aug 09 17:57:00.631867 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 57/121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:00 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:00.669422 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:00.670039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:00.676180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:00.676659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:00.677092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:00.677934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:00.678385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:00.678799 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:00.735853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:00.737052 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:00.743022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:00.743509 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:00.744166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:00.744859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:00.745306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:00.745729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:00.840374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:00.847950 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6922c1b0-88ee-4c62-869b-deffb983bb3c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.182558 Aug 09 17:57:00.848516 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 65/122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:00 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:00.901930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:00.909898 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-51dfc8f0-8a80-4f95-8a98-a7d3f6c080b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.178007 Aug 09 17:57:00.910474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 58/123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:00 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:01.028624 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-cbd394e3-028e-4357-9219-6441af9eef87 req-d3621d56-facb-49a5-b9e0-eef4af91644e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e743b93-99bc-4ef2-884d-7511bce8415f", "name": "network-vif-plugged", "status": "completed", "tag": "a18f1e80-b9c2-4442-8d36-e8cfff384bc4"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:01.033352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:01.039253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cbd394e3-028e-4357-9219-6441af9eef87 req-d3621d56-facb-49a5-b9e0-eef4af91644e service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.039723 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cbd394e3-028e-4357-9219-6441af9eef87 req-d3621d56-facb-49a5-b9e0-eef4af91644e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.040150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cbd394e3-028e-4357-9219-6441af9eef87 req-d3621d56-facb-49a5-b9e0-eef4af91644e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.051071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-cbd394e3-028e-4357-9219-6441af9eef87 req-d3621d56-facb-49a5-b9e0-eef4af91644e service nova] Creating event network-vif-plugged:a18f1e80-b9c2-4442-8d36-e8cfff384bc4 for instance 4e743b93-99bc-4ef2-884d-7511bce8415f on hv-cinder-83608 Aug 09 17:57:01.055981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-cbd394e3-028e-4357-9219-6441af9eef87 req-d3621d56-facb-49a5-b9e0-eef4af91644e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031549 Aug 09 17:57:01.056553 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 66/124] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:01.184302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:01.184833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:01.184926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:01.185385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:01.191263 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.191433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.191756 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.191913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.192197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.192346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.192888 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.193021 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.193374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.193492 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.193875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.193964 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.383985 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:01.388335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:01.391999 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4e28b36c-6211-43da-9024-6eee26a88ff1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.211579 Aug 09 17:57:01.392587 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 59/125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:01 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:01.396323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:01.397820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:01.398910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bcef9fdd-cfba-43fe-a748-c0d56fd711a5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.218405 Aug 09 17:57:01.399675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 67/126] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:01 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:01.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:01.652584 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:01.658588 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.659123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.659543 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.660222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.660669 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.661091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.796194 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:01.803523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-11ff309c-fcb6-46c3-ac2c-4267ecc7e64f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.155360 Aug 09 17:57:01.804083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 60/127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:01 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:01.869252 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:01.869787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:01.875920 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.876395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.876827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.877504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.877960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.878374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.929600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:01.930210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:01.936205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.936672 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.937103 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:01.937817 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:01.938281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:01.938695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:02.049117 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:02.052627 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:02.057344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93970157-a925-4678-8a51-fd15abb5e02b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.191926 Aug 09 17:57:02.057935 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 68/128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:01 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:02.095676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:02.103227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4dfa598e-f821-49d8-a0c4-92d6a49697dd tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.177350 Aug 09 17:57:02.103800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 61/129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:01 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:02.413085 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:02.413720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:02.419641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:02.420128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:02.420566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:02.420970 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:02.421408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:02.421581 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:02.421692 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:02.422106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:02.427926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:02.428553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:02.428997 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:02.429697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:02.430179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:02.430604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:02.615950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:02.619964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:02.624999 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:02.626511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:02.627666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6963e2ea-a48f-438f-8ae7-aff66827eb71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.210532 Aug 09 17:57:02.628231 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 62/130] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:02 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:57:02.628669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5a8a2989-d0bd-45a3-aef6-1d991c8b35e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.219674 Aug 09 17:57:02.629318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 69/131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:02 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:02.823630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:02.824365 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:02.830401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:02.830889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:02.831351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:02.832029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:02.832477 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:02.832896 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:02.963625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:02.971506 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-47afc6e9-b529-40bc-95f0-acc2af732038 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.151579 Aug 09 17:57:02.972090 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 63/132] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:02 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:03.082931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:03.083597 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:03.090190 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.090755 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.091215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.091954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.092407 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.092864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.124670 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:03.125453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:03.131482 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.132043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.132547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.133301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.133823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.134311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.278568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:03.286701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5310e3f2-a23a-4ef4-8358-dabf3822ea15 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.207550 Aug 09 17:57:03.287804 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 70/133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:03 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:03.305616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:03.313103 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a7879b4d-fcf0-4bd1-bfca-fe277887350d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.192464 Aug 09 17:57:03.318616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 64/134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:03 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:03.631688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-54bea6b2-0870-4812-af8b-622d7ba7151d req-b5a8684f-8e9c-4d22-bd92-ccda7ea93bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc776d4-095b-4bbc-89a9-b99528a089f3", "name": "network-vif-plugged", "status": "completed", "tag": "ccbb0e01-18a7-497b-830d-11366e7d9e61"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:03.643840 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-54bea6b2-0870-4812-af8b-622d7ba7151d req-b5a8684f-8e9c-4d22-bd92-ccda7ea93bb4 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.645024 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-54bea6b2-0870-4812-af8b-622d7ba7151d req-b5a8684f-8e9c-4d22-bd92-ccda7ea93bb4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.645605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-54bea6b2-0870-4812-af8b-622d7ba7151d req-b5a8684f-8e9c-4d22-bd92-ccda7ea93bb4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.653252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:03.654014 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:03.659087 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-54bea6b2-0870-4812-af8b-622d7ba7151d req-b5a8684f-8e9c-4d22-bd92-ccda7ea93bb4 service nova] Creating event network-vif-plugged:ccbb0e01-18a7-497b-830d-11366e7d9e61 for instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 on hv-cinder-83608 Aug 09 17:57:03.660642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.661221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.661983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.662775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.663354 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.663979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.674541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-54bea6b2-0870-4812-af8b-622d7ba7151d req-b5a8684f-8e9c-4d22-bd92-ccda7ea93bb4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046516 Aug 09 17:57:03.675868 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 71/135] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:03.684228 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:03.692037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:03.692893 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.693380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.693807 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.694674 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:03.695282 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:03.695556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:03.929081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:03.930738 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:03.947916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-acd7db6b-ae3b-451a-a4f8-154135ef690b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.301088 Aug 09 17:57:03.948509 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 65/136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:03 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:03.949624 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:03.951742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:03.953386 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c2dd2dd3-1b87-4daf-a8a5-f515f35904d0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.274812 Aug 09 17:57:03.954247 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 72/137] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:03 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:04.007724 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:04.009589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:04.017469 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.017968 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.018411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.019142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.019601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.020029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.180268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:04.195793 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-019da45c-febc-4584-a7c0-db16337e0c99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1322 microversion: 2.1 time: 0.207479 Aug 09 17:57:04.197344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 66/138] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:03 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:04.308937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:04.309753 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:04.318664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=91 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:04.320811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.321334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.321957 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.323409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.325131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.326064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.335921 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:04.336833 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:04.346154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.346881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.347498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.348358 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.348967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.349544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.570399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:04.579376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3292a2c0-0181-43b9-8560-ca08e364cce3 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.275333 Aug 09 17:57:04.580377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 73/139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:04 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:04.599592 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:04.603031 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:04.614208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-335de7ba-b64a-4363-9383-c0a823553ab3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.284145 Aug 09 17:57:04.615138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 67/140] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:04 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:04.969730 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:04.970327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:04.976155 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.976631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.977077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.977759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.978196 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.978793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.984315 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:04.985304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:04.992186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.992747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.993440 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:04.994398 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:04.994952 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:04.995566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.184802 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.189756 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.192335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2a323c79-db3b-48a4-bc9c-574f8d6048d7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.226276 Aug 09 17:57:05.192908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 74/141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:04 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:05.198899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.201355 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.202706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-00e9a4b1-5df5-4179-83fc-e19d288fbecb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.222886 Aug 09 17:57:05.203347 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 68/142] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:04 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:05.216389 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:05.217148 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:05.223286 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.223833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.224334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.225085 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.225607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.226109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.363888 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.371972 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ecd4519-75a3-425f-9c6a-6b14428b0ab3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1517 microversion: 2.1 time: 0.159392 Aug 09 17:57:05.372774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 75/143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:05 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:05.392894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:05.395277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:05.401229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.401696 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.402222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.402914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.403399 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.403825 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.468277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'flavor' on Instance uuid 9fa4777f-70e1-491f-9595-5e72966cddb9 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:57:05.581595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-69f46ebc-9e88-4f49-a73c-29c44d0b67f0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9/action" status: 200 len: 32 microversion: 2.1 time: 0.192633 Aug 09 17:57:05.582197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 69/144] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 17:57:05 2022] POST /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:57:05.591521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:05.592131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:05.597973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.598441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.598867 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.599570 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.600086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.600430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.603865 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:05.604567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:05.612610 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.613404 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.613404 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.614003 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.614459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.614875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.802556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.804983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.810020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-560441d3-aa78-40f5-9110-7ff38852fe5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.222235 Aug 09 17:57:05.810784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 76/145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:05 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:05.812789 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-60d27b53-d283-4ccf-b4d2-00d550a4a5b0 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.212922 Aug 09 17:57:05.813498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 70/146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:05 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:05.828977 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:05.829592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:05.835568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.836056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.836491 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.837185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:05.837637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:05.838059 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:05.969248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:05.976646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05f67518-8385-4b0b-bd80-43ccf2f50ea8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.164879 Aug 09 17:57:05.977212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 77/147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:05 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:06.213492 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:06.214098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:06.222205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.222613 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.223069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:06.223752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.224194 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.224609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:06.224985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:06.225604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:06.231957 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.232432 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.232865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:06.233545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.233995 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.234425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:06.596221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:06.599524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:06.603707 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0ab54f9f-7bdd-4b3d-a7e3-a917e035173f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.393991 Aug 09 17:57:06.604273 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 71/148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:06 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:06.609516 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:06.611170 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:06.612367 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-64fb1ff5-1767-4df9-b67f-023b1dcb6452 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.391442 Aug 09 17:57:06.612998 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 78/149] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:06 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:57:06.831847 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:06.832373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:06.833463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:06.834107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:06.834382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=93 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:06.840683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.840858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.841170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.841283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.841605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:06.841718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:06.842296 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.842390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:06.842745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.842834 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:06.843197 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:06.843305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:07.036895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:07.040010 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:07.044526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e24c620e-e06d-4976-9b95-aec7a971f990 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.214852 Aug 09 17:57:07.045279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 79/150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:06 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:07.048063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-14cda90f-228d-40a5-9a3e-d49449e64a06 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.220342 Aug 09 17:57:07.048793 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 72/151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:06 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:07.049727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:07.050331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:07.056097 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:07.056581 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:07.058046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:07.058046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:07.058241 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:07.058886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:07.186711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:07.194132 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4277a4ee-abb1-401b-9a9b-0269b5404fb3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.148008 Aug 09 17:57:07.194683 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 80/152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:07 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:07.626334 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:07.629882 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:07.633164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:07.633832 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:07.634431 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:07.635387 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:07.635948 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:07.636398 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:07.637814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:07.638606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:07.646389 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:07.646891 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:07.647355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:07.648050 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:07.648520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:07.648931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:07.830775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:07.838192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8a98e9c3-026f-45a1-8e5a-c8d46305f60e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.217264 Aug 09 17:57:07.839261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 73/153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:07 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:07.841486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:07.849441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:07.850954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:07.852077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-35b34ce7-5f9b-4954-b93f-878fac6f7643 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.219157 Aug 09 17:57:07.852637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 81/154] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:07 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:57:08.068015 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:08.068423 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:08.068859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:08.069024 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:08.075906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.076287 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.076391 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.076784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.076984 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.077471 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.077565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.077918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.078335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.078460 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.078942 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.079483 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.295411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:08.298628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:08.311808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5fcdf06e-0a57-4d9a-afe9-e9cb861bc039 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.247028 Aug 09 17:57:08.312012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6273e40a-114c-4333-b28a-ba65ceaccc73 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.249324 Aug 09 17:57:08.325905 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 82/155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:08 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:08.326270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 74/156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:08 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:08.331043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:08.331671 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:08.333312 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-52c68edf-6f26-47f3-8b60-fc052140024b req-e969f3ef-af54-40a9-aa62-3478f8ce3361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe8c172-bab3-4a24-b716-1b536176ef81", "name": "network-vif-plugged", "status": "completed", "tag": "9fa650be-eba1-4201-8c24-eb7b2ec8a90a"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:08.338039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.338519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.338949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.339737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.340195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.340628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.344178 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-52c68edf-6f26-47f3-8b60-fc052140024b req-e969f3ef-af54-40a9-aa62-3478f8ce3361 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.344900 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-52c68edf-6f26-47f3-8b60-fc052140024b req-e969f3ef-af54-40a9-aa62-3478f8ce3361 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.345219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-52c68edf-6f26-47f3-8b60-fc052140024b req-e969f3ef-af54-40a9-aa62-3478f8ce3361 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.360484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-52c68edf-6f26-47f3-8b60-fc052140024b req-e969f3ef-af54-40a9-aa62-3478f8ce3361 service nova] Creating event network-vif-plugged:9fa650be-eba1-4201-8c24-eb7b2ec8a90a for instance ffe8c172-bab3-4a24-b716-1b536176ef81 on hv-cinder-83608 Aug 09 17:57:08.365898 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-52c68edf-6f26-47f3-8b60-fc052140024b req-e969f3ef-af54-40a9-aa62-3478f8ce3361 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037160 Aug 09 17:57:08.366675 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 75/157] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:08.489622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:08.498054 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-364b5beb-5ea9-41ad-90cf-09121795cd10 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.170596 Aug 09 17:57:08.498632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 83/158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:08 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:08.859719 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:08.860422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:08.866922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.867463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.867872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.869553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.869553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.869754 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.876000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:08.876851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:08.883681 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.884391 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.884811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:08.885497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:08.885941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:08.886354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:09.087118 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:09.095824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:09.097341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:09.098452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5877ecc4-1f40-4c26-be50-ab87ec82779d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.227460 Aug 09 17:57:09.099061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 84/159] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:08 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:09.109384 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:09.116863 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b644456-5ddc-474c-99b9-d4b58744aad1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.261560 Aug 09 17:57:09.117444 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 76/160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:08 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:09.333142 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:09.333747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:09.334072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:09.334958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:09.340832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:09.341432 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:09.341873 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:09.342366 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:09.343108 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:09.343260 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:09.343342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:09.343443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:09.343517 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:09.344210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:09.345025 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:09.345639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:09.571615 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:09.572106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:09.577278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-af22c2ee-5aeb-433c-9932-a237f4e9e8a5 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1314 microversion: 2.1 time: 0.247764 Aug 09 17:57:09.577718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c9406f84-08a1-4a48-9225-1f25c6c4e726 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.248948 Aug 09 17:57:09.578489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 85/161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:09 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:09.578746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 77/162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:09 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:09.586910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:09.587654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:09.597215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:09.597855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:09.598515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:09.599513 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:09.600042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:09.600695 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:09.606198 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:09.748463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:09.756130 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4ad70ee1-8ef8-4ce5-b77f-ceb7d6ab240d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.175688 Aug 09 17:57:09.756695 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 86/163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:09 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:10.123036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:10.123571 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:10.129484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.129970 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.130408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.131131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.131596 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.132022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.140415 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:10.141230 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:10.147636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.148289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.148964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.149658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.150105 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.150520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.343084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:10.346242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:10.351391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:10.352869 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:10.354039 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-34507f89-cb5e-45ac-b9f9-79952b4cbc27 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.235637 Aug 09 17:57:10.354788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 78/164] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:10 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:10.354895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-47b51d1a-d265-4211-b881-2f5cd81a8e37 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.218861 Aug 09 17:57:10.355356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 87/165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:10 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:10.402289 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-aaae1a13-98dc-477e-855e-cabd1712d909 req-5381fc46-f51c-4699-b248-506e2e5a7e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbe1d82-6292-4a15-a16f-d0523a939fe7", "name": "network-vif-plugged", "status": "completed", "tag": "c2bfe46e-68c0-434d-be2c-a2ea6aaac310"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:10.412499 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aaae1a13-98dc-477e-855e-cabd1712d909 req-5381fc46-f51c-4699-b248-506e2e5a7e43 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.413047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aaae1a13-98dc-477e-855e-cabd1712d909 req-5381fc46-f51c-4699-b248-506e2e5a7e43 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.413474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aaae1a13-98dc-477e-855e-cabd1712d909 req-5381fc46-f51c-4699-b248-506e2e5a7e43 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.425016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-aaae1a13-98dc-477e-855e-cabd1712d909 req-5381fc46-f51c-4699-b248-506e2e5a7e43 service nova] Creating event network-vif-plugged:c2bfe46e-68c0-434d-be2c-a2ea6aaac310 for instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 on hv-cinder-83608 Aug 09 17:57:10.429774 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-aaae1a13-98dc-477e-855e-cabd1712d909 req-5381fc46-f51c-4699-b248-506e2e5a7e43 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Aug 09 17:57:10.430356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 79/166] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:10.600180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:10.600803 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:10.601963 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:10.603030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:10.608436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.608918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.609355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.609674 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.610149 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.610259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.610586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.610700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.611049 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.611313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.611765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.612197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.827481 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:10.831018 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:10.835491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-77e6c468-43e4-4dd1-89cd-a5c9aa27366c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.237624 Aug 09 17:57:10.836131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 80/167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:10 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:10.840877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:10.841487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:10.847864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.848346 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.848821 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.849551 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:10.850400 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:10.850911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:10.853041 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-35077c56-0750-4dd7-af8e-55ca13181917 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1501 microversion: 2.1 time: 0.256684 Aug 09 17:57:10.853627 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 88/168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:10 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:11.006810 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:11.023207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-98f662ec-77db-43f0-9268-4de63c98a1ae tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.177996 Aug 09 17:57:11.023207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 81/169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:10 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:11.375712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:11.376325 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:11.376659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:11.377363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:11.382344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:11.382819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:11.383284 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:11.383803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:11.383964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:11.384406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:11.384498 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:11.384823 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:11.385027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:11.385772 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:11.386286 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:11.386776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:11.585914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:11.587133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:11.595390 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:11.596911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:11.597032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e8e56be7-59cf-4b68-a51c-a3f6e7b0a2ea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.225348 Aug 09 17:57:11.597915 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 89/170] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:11 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:11.599549 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c7dd3374-f17b-40f1-ac6b-2c3a0f7fbcf5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.227056 Aug 09 17:57:11.600350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 82/171] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:11 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:57:11.858190 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:11.858805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:11.864746 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:11.865223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:11.865653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:11.866352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:11.866807 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:11.867264 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:12.002590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:12.010139 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-950a336a-c246-4915-b057-2b63834a99ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.155835 Aug 09 17:57:12.010714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 90/172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:11 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:12.036114 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:12.036721 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:12.042568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:12.043056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:12.044144 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:12.044826 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:12.045272 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:12.045695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:12.176782 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:12.180217 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:12.185704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2361fb07-f121-4594-aa6b-57ba22f93fcf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.153307 Aug 09 17:57:12.186272 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 83/173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:12 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:12.617325 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:12.617869 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:12.623406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:12.623886 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:12.625084 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:12.625620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:12.626050 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:12.626744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:12.627222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:12.627642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:12.630757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:12.631272 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:12.631717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:12.632410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:12.632862 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:12.633290 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:12.822922 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:12.826685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:12.831177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6f9f5c59-d5c7-492e-8004-2d62490b8f72 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.217728 Aug 09 17:57:12.831747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 91/174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:12 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:12.835002 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:12.836516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:12.837611 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-385d2be7-e54c-4955-ae29-2f82cc8d9853 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.220157 Aug 09 17:57:12.838168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 84/175] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:12 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:57:13.030503 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:13.031155 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:13.037041 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.037528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.037965 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:13.038649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.039136 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.039564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:13.173271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:13.180607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fdbf3502-976b-4880-b26f-e22d375dba3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.154117 Aug 09 17:57:13.181154 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 92/176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:13 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:13.205653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:13.206295 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:13.212238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.212720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.213155 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:13.213837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.214291 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.214712 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:13.344693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:13.352005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ac6cae57-3006-42a9-955e-07f35307dbb4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.150230 Aug 09 17:57:13.352574 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 85/177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:13 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:13.851980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:13.852598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:13.858762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.859287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.859423 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:13.859841 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:13.859919 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:13.860414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.860894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.861360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:13.866114 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.866604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.867076 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:13.867776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:13.868230 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:13.868656 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:14.060075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:14.066522 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:14.067703 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d8c45a27-c9fd-409e-b409-404c4bc11542 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.219445 Aug 09 17:57:14.068274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 93/178] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:13 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:14.075612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:14.077113 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:14.078244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-06ea6eb7-b119-4c8d-a54f-fd098f37a5ce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.222745 Aug 09 17:57:14.078828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 86/179] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:13 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:57:14.202521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:14.203287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:14.209291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:14.209778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:14.210213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:14.210901 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:14.211379 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:14.211833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:14.358580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:14.366065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-60dfa8b0-0f84-4de8-be55-44dfe9aa6e37 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.168329 Aug 09 17:57:14.366702 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 94/180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:14 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:14.369390 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994d7e15-b48f-4223-8ea9-30138fdfc3a0"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:14.372962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:14.375880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:14.376659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:14.379195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:14.379671 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:14.380300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:14.381044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:14.381551 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:14.382049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:14.383887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:14.384376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:14.384812 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:14.385601 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:14.386128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:14.386670 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:14.579848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:14.594443 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-854f789a-6da2-43f4-b978-b8bfd17e4534 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1363 microversion: 2.1 time: 0.226339 Aug 09 17:57:14.595064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 95/181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:14 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:15.089197 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:15.089811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:15.096551 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.097031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.097465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.098144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.098590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.099035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.236999 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:15.244614 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cd2510aa-7fdc-41c6-b468-2ee1ab2d9ede tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.159084 Aug 09 17:57:15.245059 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 96/182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:15 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:15.249719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:15.250317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:15.255973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.256452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.256882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.257559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.258005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.258425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.399789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:15.412089 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:15.413670 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:15.414804 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-540a7788-0fad-4dc2-b470-cd905f80015c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.168840 Aug 09 17:57:15.415445 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 97/183] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:15 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:15.420319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:15.421110 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:15.427696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.428178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.428788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.429731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.430392 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.431053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.577974 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:15.593117 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5538066f-c456-4a74-a233-50ac1302d72a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.176408 Aug 09 17:57:15.599482 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 98/184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:15 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:15.617936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:15.618598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:15.625734 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.626227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.626845 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.627696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.628155 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.628587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.785385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:15.795499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bbf4cc5f-8e45-4d50-aa8a-536f25b5c8e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1549 microversion: 2.1 time: 0.182518 Aug 09 17:57:15.796638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 99/185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:15 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:15.820440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:15.821273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:15.829094 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.839942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.841358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.842349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.843189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.843689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.013912 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b7d8c7dd-5f53-4fff-ba76-1ba97a9c48b2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197361 Aug 09 17:57:16.015005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 100/186] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 17:57:15 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:57:16.057747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3ef7f320-0161-4901-812b-5510a713e33b tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "POST /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.692839 Aug 09 17:57:16.064510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 87/187] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 17:57:14 2022] POST /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f/os-volume_attachments => generated 194 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:57:16.265336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:16.266482 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:16.273536 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.274211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.274886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.275652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.276306 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.276885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.439426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:16.440092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:16.448842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.449603 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.450471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.451425 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.452105 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.452749 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.455528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:16.463700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c02b139-263a-498c-a6a4-2694fe8ea830 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.202345 Aug 09 17:57:16.478624 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 101/188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:16 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:16.615336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:16.615946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:16.622004 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.623127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.623877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.624583 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.625034 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.625452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.640685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:16.657874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:16.661371 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:16.665318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6988496-1d60-4def-82d3-8285228a2d11 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.230130 Aug 09 17:57:16.666876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 88/189] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:16 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:16.841750 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:16.849911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f64e0e0c-ff07-4027-a99e-3b3c9d9abad7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.239214 Aug 09 17:57:16.850486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 102/190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:16 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:17.475717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-74217ca4-8ca0-4b0f-bf05-07819899c70c req-314f4a51-6d3c-4e3f-a8ae-cf9cd178294a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc776d4-095b-4bbc-89a9-b99528a089f3", "tag": "ccbb0e01-18a7-497b-830d-11366e7d9e61"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:17.485305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:17.485908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:17.489771 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-74217ca4-8ca0-4b0f-bf05-07819899c70c req-314f4a51-6d3c-4e3f-a8ae-cf9cd178294a service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.490418 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-74217ca4-8ca0-4b0f-bf05-07819899c70c req-314f4a51-6d3c-4e3f-a8ae-cf9cd178294a service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.491165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-74217ca4-8ca0-4b0f-bf05-07819899c70c req-314f4a51-6d3c-4e3f-a8ae-cf9cd178294a service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.498564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.499135 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.499568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.502036 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.502779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.503334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.505511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-74217ca4-8ca0-4b0f-bf05-07819899c70c req-314f4a51-6d3c-4e3f-a8ae-cf9cd178294a service nova] Creating event network-changed:ccbb0e01-18a7-497b-830d-11366e7d9e61 for instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 on hv-cinder-83608 Aug 09 17:57:17.510653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-74217ca4-8ca0-4b0f-bf05-07819899c70c req-314f4a51-6d3c-4e3f-a8ae-cf9cd178294a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039564 Aug 09 17:57:17.515041 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 89/191] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:17.530748 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:17.690633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:17.691609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:17.698504 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.700213 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.700798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.701606 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.702286 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.702597 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.713666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:17.723538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-80033418-9e33-4714-a17d-c2de941c4fae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.242462 Aug 09 17:57:17.724962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 103/192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:17 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:17.870641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:17.871287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:17.878243 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.879141 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.879743 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.880647 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.881257 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.881843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.886414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:17.896621 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:17.898641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:17.900665 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-496f7154-b705-4f97-87a0-1164f79e4cd3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.213976 Aug 09 17:57:17.917634 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 90/193] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:17 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:57:18.046005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:18.053964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e1b62083-a93d-4701-9943-9e37a8d0e55b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.187402 Aug 09 17:57:18.054777 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 104/194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:17 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:18.746087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:18.747344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:18.755058 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:18.755918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:18.756368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:18.757077 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:18.757533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:18.757981 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:18.900962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:18.909943 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fc933f1d-36b5-4dc7-8b50-79a3c9e1f5be tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.167988 Aug 09 17:57:18.910566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 91/195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:18 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:18.925653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:18.926270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:18.932809 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:18.933297 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:18.933744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:18.935170 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:18.935631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:18.936060 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:19.075021 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:19.075617 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:19.083526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:19.084021 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:19.084455 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:19.085156 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:19.085605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:19.086025 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:19.141690 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:19.150370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:19.152067 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:19.153446 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1943813a-0c4d-4c24-bd6d-150fa0d89341 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.232327 Aug 09 17:57:19.154682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 105/196] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:18 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:19.251752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:19.259304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-08bd1b6b-6c68-4f2c-803a-cf3e70ac9e31 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.188223 Aug 09 17:57:19.259883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 92/197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:19 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:19.931026 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:19.931640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:19.938647 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:19.939293 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:19.939732 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:19.940418 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:19.940872 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:19.941299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:20.069575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:20.077959 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-35644ed9-181f-4faf-baac-431156dea310 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.150748 Aug 09 17:57:20.078523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 106/198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:19 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:20.177804 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:20.178397 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:20.185660 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:20.186255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:20.186841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:20.187668 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:20.188132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:20.188566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:20.280489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:20.281106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:20.288478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:20.288990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:20.289866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:20.290717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:20.291438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:20.292020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:20.345845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:20.354675 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:20.361789 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:20.362942 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3ebfe1c1-1a5a-4e5f-ac07-04b26c039cb3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.189218 Aug 09 17:57:20.382882 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 93/199] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:20 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:20.496061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:20.505217 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8a31aacf-6320-467f-92a3-cb95aed34e47 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.228700 Aug 09 17:57:20.505794 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 107/200] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:20 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:21.097846 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:21.098458 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:21.104499 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.104983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.105412 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:21.106136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.106597 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.107051 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:21.233302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:21.240658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a7c7935b-ce03-4f38-91ff-1e241fb7b4b1 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.146690 Aug 09 17:57:21.241238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 94/201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:21 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:21.390253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:21.390774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:21.396788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.397271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.397706 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:21.398393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.398846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.399296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:21.526534 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:21.527281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:21.530075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:21.534050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.534542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.534998 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:21.536197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.536197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.536572 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:21.537926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:21.540426 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:21.541569 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d1f0001a-e38e-4932-8189-cae1b92278eb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.155824 Aug 09 17:57:21.542261 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 108/202] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:21 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:21.664419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:21.671883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8c9c02cf-f06b-4e3f-ac43-ace4983d8208 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.149182 Aug 09 17:57:21.672457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 95/203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:21 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:22.261784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:22.262406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:22.268498 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:22.268926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:22.269360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:22.270046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:22.270499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:22.270924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:22.400665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:22.408469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e89714a6-595b-46b6-ba37-d484e8e0ad97 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.150654 Aug 09 17:57:22.409029 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 109/204] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:22 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:22.563745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:22.564285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:22.570667 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:22.571183 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:22.571624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:22.572306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:22.572756 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:22.573175 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:22.692958 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:22.693712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:22.699091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:22.700448 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:22.701180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:22.701629 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:22.702451 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:22.702908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:22.703359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:22.707976 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:22.709475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:22.710558 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2f4bd5c-4970-4338-8046-b88e393b1cb0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.150859 Aug 09 17:57:22.711133 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 96/205] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:22 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:22.836211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:22.844198 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c7996f66-e990-4b58-b5f9-d857e635a728 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.155125 Aug 09 17:57:22.844763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 110/206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:22 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:23.429575 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:23.430210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:23.436926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.437409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.437847 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.438550 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.439026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.439457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.570427 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:23.578051 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a62090d0-7577-41a5-bba6-00c8e39f07ec tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.152408 Aug 09 17:57:23.578612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 97/207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:23 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:23.735341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:23.735845 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:23.741731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.742214 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.742640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.743337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.743778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.744193 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.864908 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:23.865640 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:23.871857 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.872337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.872768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.873526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:23.873715 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.874160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.874574 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.882746 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:23.884279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:23.885360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3b1b844e-ce37-47ee-8ddc-19975b6522e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.155063 Aug 09 17:57:23.885893 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 111/208] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:23 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:24.011735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:24.019109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-54ed0e82-5bbf-4b75-a275-4c6dfa9063c9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.158270 Aug 09 17:57:24.019675 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 98/209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:23 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:24.597692 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:24.598305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:24.604337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:24.604822 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:24.605254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:24.605939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:24.606387 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:24.606805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:24.772592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:24.780039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eea852cc-5639-455c-9d30-c3469c8e8414 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.186277 Aug 09 17:57:24.780610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 112/210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:24 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:24.908191 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:24.909513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:24.915889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:24.916232 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:24.916854 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:24.917655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:24.918100 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:24.919238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:25.046674 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:25.048231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:25.059805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:25.061051 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:25.062262 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:25.065155 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:25.066525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:25.067652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:25.207982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:25.211616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:25.219489 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:25.221003 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:25.222119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d876c8d4-c820-4e78-85cc-356da676ba20 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1408 microversion: 2.20 time: 0.318407 Aug 09 17:57:25.222687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 99/211] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:24 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:25.254369 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:25.262230 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2a6900a0-c7a3-442c-af23-be8fbb765d9a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.225438 Aug 09 17:57:25.262902 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 113/212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:25 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:25.800703 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:25.801329 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:25.808160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:25.808642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:25.809075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:25.809786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:25.810295 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:25.810664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:25.940197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:25.947599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a406264b-70ab-4a72-858e-f84a1fc4c38a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1366 microversion: 2.1 time: 0.151412 Aug 09 17:57:25.948167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 100/213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:25 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:26.245061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:26.246558 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:26.254238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.254930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.255465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.256911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.257431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.257928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.287478 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:26.288083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:26.294186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.295007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.295676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.296610 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.297201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.297882 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.480347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:26.490270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:26.492019 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:26.493160 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc2575e7-b5ed-416b-af3a-e33d21f3a6bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1600 microversion: 2.20 time: 0.252642 Aug 09 17:57:26.507988 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 114/214] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:57:26 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1600 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:57:26.516550 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:26.521586 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:26.522088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:26.524515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-429b1150-2b62-435b-b938-5eef4c06343f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.242421 Aug 09 17:57:26.525095 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 101/215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:26 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:26.533774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.533774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.533774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.533774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.534317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.534317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.790531 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-08b74431-d5da-43a4-a13b-4e23ba91daf9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.276899 Aug 09 17:57:26.791177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 115/216] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Aug 9 17:57:26 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:57:26.970750 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:26.971298 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:26.977728 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.978710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.978710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.979339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.979890 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.980299 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.254101 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:27.261993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e77fb752-8291-47c9-9fa5-a188d2d06862 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1554 microversion: 2.1 time: 0.295643 Aug 09 17:57:27.263391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 102/217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:26 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1554 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:27.284242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:27.284796 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:27.290588 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.291133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.291566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.292302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.292730 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.293152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.445382 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b4e5554d-7dd7-444f-b8ef-b82c06888c5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164917 Aug 09 17:57:27.446104 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 116/218] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 17:57:27 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:27.545917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:27.545917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:27.551872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.552364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.552797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.553507 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.553953 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.554376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:28.165618 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:28.173651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b2c1b262-bdea-4aa1-b833-d8804e37ca4b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.632233 Aug 09 17:57:28.174219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 103/219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:27 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:28.912197 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-3bdfc6cc-60e3-456e-b5a2-6066b4034eee req-bc9bd4e1-60c3-4e89-8dfe-ee49676c2668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe8c172-bab3-4a24-b716-1b536176ef81", "tag": "9fa650be-eba1-4201-8c24-eb7b2ec8a90a"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:28.922962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-3bdfc6cc-60e3-456e-b5a2-6066b4034eee req-bc9bd4e1-60c3-4e89-8dfe-ee49676c2668 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:28.923720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-3bdfc6cc-60e3-456e-b5a2-6066b4034eee req-bc9bd4e1-60c3-4e89-8dfe-ee49676c2668 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:28.924299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-3bdfc6cc-60e3-456e-b5a2-6066b4034eee req-bc9bd4e1-60c3-4e89-8dfe-ee49676c2668 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:28.937182 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-3bdfc6cc-60e3-456e-b5a2-6066b4034eee req-bc9bd4e1-60c3-4e89-8dfe-ee49676c2668 service nova] Creating event network-changed:9fa650be-eba1-4201-8c24-eb7b2ec8a90a for instance ffe8c172-bab3-4a24-b716-1b536176ef81 on hv-cinder-83608 Aug 09 17:57:28.942531 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-3bdfc6cc-60e3-456e-b5a2-6066b4034eee req-bc9bd4e1-60c3-4e89-8dfe-ee49676c2668 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034060 Aug 09 17:57:28.943645 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 117/220] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:57:29.195362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:29.196605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:29.204204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:29.204686 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:29.205120 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:29.205815 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:29.206267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:29.206691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:29.354294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:29.363697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-988667a8-8f29-4d03-885d-6301eff7045f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.172061 Aug 09 17:57:29.364278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 104/221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:29 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:30.386359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:30.387073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:30.393769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:30.394240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:30.394673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:30.395378 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:30.395825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:30.396246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:30.528639 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:30.536234 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af1598cf-4df4-4e53-b8c6-c92e5f3048c1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.154190 Aug 09 17:57:30.536805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 118/222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:30 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:30.958195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-3d540f66-a0da-4899-90a5-43c64d341bc6 req-021f8735-b427-48c4-863b-1d11eddba38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbe1d82-6292-4a15-a16f-d0523a939fe7", "tag": "c2bfe46e-68c0-434d-be2c-a2ea6aaac310"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:30.968113 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-3d540f66-a0da-4899-90a5-43c64d341bc6 req-021f8735-b427-48c4-863b-1d11eddba38b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:30.968573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-3d540f66-a0da-4899-90a5-43c64d341bc6 req-021f8735-b427-48c4-863b-1d11eddba38b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:30.969195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-3d540f66-a0da-4899-90a5-43c64d341bc6 req-021f8735-b427-48c4-863b-1d11eddba38b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.125958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-3d540f66-a0da-4899-90a5-43c64d341bc6 req-021f8735-b427-48c4-863b-1d11eddba38b service nova] Creating event network-changed:c2bfe46e-68c0-434d-be2c-a2ea6aaac310 for instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 on hv-cinder-83608 Aug 09 17:57:31.131324 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-3d540f66-a0da-4899-90a5-43c64d341bc6 req-021f8735-b427-48c4-863b-1d11eddba38b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177019 Aug 09 17:57:31.131923 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 105/223] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:31.556819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:31.557447 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:31.563438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:31.563929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:31.564371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.565063 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:31.565520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:31.565943 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.698751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:31.706553 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-da5910a2-3620-4662-a53c-7ee5b36c596c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.153579 Aug 09 17:57:31.707130 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 119/224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:31 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:32.729471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:32.730498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:32.737552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:32.738073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:32.738516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:32.739374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:32.739832 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:32.740257 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:32.882950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:32.890538 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7184b678-9bcc-40ca-a5fc-e8576553d299 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.166039 Aug 09 17:57:32.891146 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 106/225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:32 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:33.914333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:33.914963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:33.921723 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:33.922359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:33.922802 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:33.924579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:33.925718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:33.926213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:34.163099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:34.171696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a264cb8e-602f-4e12-b672-5d9ca586e9f1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.262439 Aug 09 17:57:34.172950 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 120/226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:33 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:35.204936 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:35.205822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:35.216006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:35.216768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:35.217480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:35.218694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:35.219487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:35.220140 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:35.396395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:35.404763 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b2a30b5e-4453-4f2d-8166-dd1403119cff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.206839 Aug 09 17:57:35.405414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 107/227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:35 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:36.426439 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:36.427074 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:36.429360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=96 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:36.435246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:36.435729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:36.436162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:36.436853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:36.437300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:36.437719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:36.441995 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:36.574417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:36.581881 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-74d4be02-b561-4b87-8b9f-e3a730390bac tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.159573 Aug 09 17:57:36.582445 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 121/228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:36 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:37.602982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:37.603615 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:37.606619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=72 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:37.612607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:37.613772 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:37.614409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:37.615169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:37.615630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:37.616059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:37.843927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:37.853476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-519b00ac-bc0f-4a6e-802f-976fa23fe320 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.254265 Aug 09 17:57:37.854042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 108/229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:37 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:38.875654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:38.876272 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:38.883461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:38.883973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:38.884554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:38.885283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:38.885768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:38.886360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:39.034732 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:39.044453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-801165bd-0a7e-450a-a53c-ed0b8ab19f24 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.171419 Aug 09 17:57:39.044453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 122/230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:38 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:40.066216 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:40.066835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:40.073860 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.074350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.075326 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.076053 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.076508 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.076967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.311106 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:40.318809 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c5d04083-44ba-49b7-8318-7c5754c6c49c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.256863 Aug 09 17:57:40.319528 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 109/231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:40 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:41.341092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:41.342437 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:41.349215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:41.350134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:41.350740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:41.351488 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:41.351941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:41.352526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:41.491616 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:41.503189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-92497cb7-b0e3-4657-9b57-bff731b007f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.166302 Aug 09 17:57:41.505147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 123/232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:41 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:42.527854 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:42.528474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:42.536348 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:42.537246 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:42.537767 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:42.538536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:42.539008 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:42.539432 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:42.692804 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:42.704576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3cbe2721-b665-45f3-a830-73a2fecd5ac4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.180733 Aug 09 17:57:42.705560 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 110/233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:42 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:43.725937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:43.726960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:43.734343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:43.737619 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:43.738887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:43.741971 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:43.742500 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:43.743017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:43.892298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:43.900727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3075db00-c177-48bf-b25f-3fdfadc9d88a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.178718 Aug 09 17:57:43.901302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 124/234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:43 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:44.932311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:44.934419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:44.943836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.944329 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.944764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.945629 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.946284 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.947196 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:45.133966 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:45.153306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-694fb736-6918-4868-8c4e-8e5e3ac5c876 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.226181 Aug 09 17:57:45.155274 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 111/235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:44 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:46.177509 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:46.178131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:46.186061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:46.186061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:46.186061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:46.186594 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:46.187071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:46.187501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:46.357420 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:46.372637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d10e66de-f785-4f42-b8ff-1d25249791c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.197726 Aug 09 17:57:46.373955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 125/236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:46 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:47.407215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:47.408163 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:47.414882 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:47.415404 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:47.415841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:47.416541 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:47.416997 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:47.417419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:47.564529 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:47.572818 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7dbaadc8-fecc-42e4-89a0-709ca6e1b8bd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.173034 Aug 09 17:57:47.573403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 112/237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:47 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:47.619407 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1739652401", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "networks": [{"uuid": "74ef389c-b413-4ad8-b86e-27ca15635e59"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:47.673727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] validate_networks() for [('74ef389c-b413-4ad8-b86e-27ca15635e59', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:57:48.079303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:57:48.079934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:57:48.080687 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:57:48.081211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:57:48.081583 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:57:48.092199 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.092712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.093452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.094513 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.095157 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.095701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.123923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Getting quotas for project c00730b67ae04f58be1322a80cc6a4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:57:48.130515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Getting quotas for user ff0c1d9939374d14bbc7cacad41162ea and project c00730b67ae04f58be1322a80cc6a4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:57:48.145115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:57:48.148425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:57:48.201851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-15ec8b11-0b95-4222-af05-889f2812e6f2 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586261 Aug 09 17:57:48.203161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 126/238] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:57:48.214656 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cbcc18fb-3e0d-4e3b-ad64-b120e2fb0b1e tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:48.215681 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cbcc18fb-3e0d-4e3b-ad64-b120e2fb0b1e tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:48.263213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:48.264208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:48.271174 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.272021 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.272673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.273679 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.274310 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.274961 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.296450 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cbcc18fb-3e0d-4e3b-ad64-b120e2fb0b1e tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:48.304246 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cbcc18fb-3e0d-4e3b-ad64-b120e2fb0b1e tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1214 microversion: 2.1 time: 0.094091 Aug 09 17:57:48.305134 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 113/239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:48 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:48.318418 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:57:48.401590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6dcf2cb9-e9bc-4303-be66-2e4cc157111e tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 204 len: 0 microversion: 2.1 time: 0.142035 Aug 09 17:57:48.402178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 127/240] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 17:57:48 2022] DELETE /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:57:48.410190 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:48.410798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:48.417976 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.419094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.423367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.423367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.423367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.423367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.558606 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:48.566728 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-511bab9f-4827-4b93-8eea-0817acc1ab28 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1553 microversion: 2.1 time: 0.160342 Aug 09 17:57:48.567326 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 114/241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:48 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:48.594618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:48.595336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:48.601816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.602388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.602617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.603331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.603776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.604194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.738689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:48.746113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e59b9be8-f752-481e-bb1d-100119aaf002 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.156214 Aug 09 17:57:48.747221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 128/242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:48 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:49.325675 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:49.326286 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:49.332523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.333007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.333443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.334138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.334589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.335032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.396023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:49.403876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e05a122b-4e90-4817-b47d-a7aa3ae41f03 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1218 microversion: 2.1 time: 0.081952 Aug 09 17:57:49.404445 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 115/243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:49 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:49.587716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:49.588235 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:49.594685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.595194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.595618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.596315 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.596758 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.597168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.725832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:49.735793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7f7881b4-1b93-4459-89f5-d17d6d8140e7 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1553 microversion: 2.1 time: 0.151911 Aug 09 17:57:49.736383 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 129/244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:49 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:49.768603 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:49.769491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:49.774862 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.775369 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.775799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.776483 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.776927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.777382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.908291 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:49.915888 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5e54dee9-8367-45e2-a04c-d4e50ca83ae3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.151686 Aug 09 17:57:49.916465 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 116/245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:49 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:50.425151 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:50.425694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:50.439586 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.440077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.440504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:50.441203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.441653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.442072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:50.505743 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:50.513343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-02c35756-c7e9-4c3a-888e-3b27a6c5cf29 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1218 microversion: 2.1 time: 0.092269 Aug 09 17:57:50.513919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 130/246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:50 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:50.757740 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:50.758268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:50.764512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.764994 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.765424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:50.766103 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.766548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.766992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:50.896993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:50.905819 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a604297e-5d9a-4553-8587-dcb8701e9915 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1553 microversion: 2.1 time: 0.151907 Aug 09 17:57:50.906439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 117/247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:50 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:50.937078 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:50.937686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:50.944170 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.944655 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.945086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:50.945777 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.946328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.946760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:51.091613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:51.101329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e9222b88-233a-4673-877b-6246f08db4b4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.166010 Aug 09 17:57:51.101329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 131/248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:50 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:51.534623 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:51.535268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:51.541205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:51.541682 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:51.542112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:51.542789 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:51.543925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:51.544345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:51.548239 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:51.604321 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:51.612676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c3b89111-ca09-404a-a80d-fd70e98b9c66 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1218 microversion: 2.1 time: 0.081945 Aug 09 17:57:51.613240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 118/249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:51 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:51.927510 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:51.928175 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:51.934250 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:51.934736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:51.935206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:51.935896 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:51.936346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:51.936766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.075333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:52.084017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-20322a59-c6dd-4609-828c-27ed8622a83c tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1553 microversion: 2.1 time: 0.160351 Aug 09 17:57:52.084587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 132/250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:51 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:52.120215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:52.120831 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:52.128691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:52.129172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:52.129609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.130300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:52.130768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:52.131229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.263902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:52.271459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c42fd1da-192b-4ee1-9cd2-e84daa232272 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.154966 Aug 09 17:57:52.272236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 119/251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:52 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:52.636223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:52.637276 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:52.646997 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:52.648376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:52.649496 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.650940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:52.651658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:52.652436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.891874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:52.905997 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2f6eb631-3363-43d9-a9da-d2d42aac9356 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1266 microversion: 2.1 time: 0.275928 Aug 09 17:57:52.907009 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 133/252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:52 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:53.107075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:53.107851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:53.114221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:53.114939 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:53.115394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:53.116281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:53.116872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:53.117310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:53.291946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:53.293717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:53.299908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:53.300390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:53.300983 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:53.301829 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:53.302426 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:53.303008 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:53.693840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18740d304014f8caa523b5d41500140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7eada23fab4b428e8dd7be1738cea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:53.702719 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-39cfc896-508d-4e17-9440-3fbf8ecf31a6 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 200 len: 1553 microversion: 2.1 time: 0.600766 Aug 09 17:57:53.715223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 120/253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:53 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 1553 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:53.715223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-36dfc23b-0534-4f4c-b375-3597c56f7221 req-a1605a88-2ba4-4706-937b-73f9791c117b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e743b93-99bc-4ef2-884d-7511bce8415f", "name": "network-vif-deleted", "tag": "a18f1e80-b9c2-4442-8d36-e8cfff384bc4"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:53.728593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-36dfc23b-0534-4f4c-b375-3597c56f7221 req-a1605a88-2ba4-4706-937b-73f9791c117b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:53.729282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-36dfc23b-0534-4f4c-b375-3597c56f7221 req-a1605a88-2ba4-4706-937b-73f9791c117b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:53.729929 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-36dfc23b-0534-4f4c-b375-3597c56f7221 req-a1605a88-2ba4-4706-937b-73f9791c117b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:53.747446 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-36dfc23b-0534-4f4c-b375-3597c56f7221 req-a1605a88-2ba4-4706-937b-73f9791c117b service nova] Creating event network-vif-deleted:a18f1e80-b9c2-4442-8d36-e8cfff384bc4 for instance 4e743b93-99bc-4ef2-884d-7511bce8415f on hv-cinder-83608 Aug 09 17:57:53.753218 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-36dfc23b-0534-4f4c-b375-3597c56f7221 req-a1605a88-2ba4-4706-937b-73f9791c117b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048522 Aug 09 17:57:53.754598 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 121/254] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:53.772901 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:53.786587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0c613dfd-8090-47c3-aa62-46cad40ced0c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.498298 Aug 09 17:57:53.787492 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 134/255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:53 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:53.929961 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:53.931132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:53.944981 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:53.945917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:53.947665 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:53.948466 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:53.949292 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:53.950502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.036226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:54.044533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8fcd8071-eb5f-4e3d-914e-759bf4ad67b6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1272 microversion: 2.1 time: 0.120684 Aug 09 17:57:54.045429 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 122/256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:53 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:54.728068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:54.729348 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:54.737032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.737725 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.738326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.739549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.740312 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.740889 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.756415 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] HTTP exception thrown: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Request method failure captured: Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f HTTP/1.1 Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_F5MycUfL2PWVpD6lhcz0KNKDR9GXSpwp2EW_dP6_eP8Qq6laITYLY6hATTYrva1fhDQ22wUrbAPmGC-x_GIQ7mwbeg_VZJyBcDRBK8ofUb-RIt9ZrD_m6KWPw1XMphc7w42HMatOd73xs2iDNllkXbrx-x2rd4bygp-JHvTIQvPE Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 17:57:54.769904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7eada23fab4b428e8dd7be1738cea5", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: e18740d304014f8caa523b5d41500140 Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:54.771941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '4e743b93-99bc-4ef2-884d-7511bce8415f'} Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:57:54.772981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:54.774550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:54.775906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Returning 404 to user: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:57:54.777112 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-313f24a2-fc0a-400b-8cce-99fa13abab7d tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 404 len: 111 microversion: 2.1 time: 0.053412 Aug 09 17:57:54.777958 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 135/257] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:54 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:57:54.808475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:54.810532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:54.818189 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.818837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.819501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.820403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.820867 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.821300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.958596 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:54.961192 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:54.968620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.969347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.969996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.971069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.971712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.972361 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.989686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] HTTP exception thrown: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Request method failure captured: Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f/os-volume_attachments HTTP/1.1 Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_F5MycUfL2PWVpD6lhcz0KNKDR9GXSpwp2EW_dP6_eP8Qq6laITYLY6hATTYrva1fhDQ22wUrbAPmGC-x_GIQ7mwbeg_VZJyBcDRBK8ofUb-RIt9ZrD_m6KWPw1XMphc7w42HMatOd73xs2iDNllkXbrx-x2rd4bygp-JHvTIQvPE Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 17:57:54.999599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7eada23fab4b428e8dd7be1738cea5", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: e18740d304014f8caa523b5d41500140 Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:55.000843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'server_id': '4e743b93-99bc-4ef2-884d-7511bce8415f'} Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:57:55.001611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:55.002669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:57:55.005618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Returning 404 to user: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:57:55.005618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d1b3c48a-4483-46a8-b18c-ac7d877cbd26 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046647 Aug 09 17:57:55.005618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 136/258] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 17:57:54 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:57:55.070609 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:55.071937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:55.084932 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:55.088132 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:55.088785 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:55.089775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:55.090236 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:55.102552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:55.219461 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:55.230151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2e04c98f-2153-4de4-af34-ee39b014e8d9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.425742 Aug 09 17:57:55.235426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 123/259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:54 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:55.395404 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:55.403916 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c0c93dd2-694a-4104-ab8b-5cfc83782e42 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.337900 Aug 09 17:57:55.405732 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 137/260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:55 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:55.468289 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-51795c4b-99a4-494d-a2cc-4bfe52b52ce4 req-7679971c-8c10-45cd-a20b-bbd146490a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7d15c2-3dd8-4695-a8fb-410b8d55b69d", "tag": "9aa78aea-4c2a-45dc-b9c0-fb36364eb873"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:55.479093 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-51795c4b-99a4-494d-a2cc-4bfe52b52ce4 req-7679971c-8c10-45cd-a20b-bbd146490a55 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:55.479576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-51795c4b-99a4-494d-a2cc-4bfe52b52ce4 req-7679971c-8c10-45cd-a20b-bbd146490a55 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:55.480593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-51795c4b-99a4-494d-a2cc-4bfe52b52ce4 req-7679971c-8c10-45cd-a20b-bbd146490a55 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:55.499174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-51795c4b-99a4-494d-a2cc-4bfe52b52ce4 req-7679971c-8c10-45cd-a20b-bbd146490a55 service nova] Creating event network-changed:9aa78aea-4c2a-45dc-b9c0-fb36364eb873 for instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d on hv-cinder-83608 Aug 09 17:57:55.505345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-51795c4b-99a4-494d-a2cc-4bfe52b52ce4 req-7679971c-8c10-45cd-a20b-bbd146490a55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041956 Aug 09 17:57:55.506182 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 124/261] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:56.253318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:56.253828 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:56.259791 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.260270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.260705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.261637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.262131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.262593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.267070 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:56.292381 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:56.293714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:56.302700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.303226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.303673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.304376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.304830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.305255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.321592 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] HTTP exception thrown: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Request method failure captured: Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f HTTP/1.1 Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_F5MycUfL2PWVpD6lhcz0KNKDR9GXSpwp2EW_dP6_eP8Qq6laITYLY6hATTYrva1fhDQ22wUrbAPmGC-x_GIQ7mwbeg_VZJyBcDRBK8ofUb-RIt9ZrD_m6KWPw1XMphc7w42HMatOd73xs2iDNllkXbrx-x2rd4bygp-JHvTIQvPE Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 17:57:56.329219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7eada23fab4b428e8dd7be1738cea5", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: e18740d304014f8caa523b5d41500140 Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.330687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '4e743b93-99bc-4ef2-884d-7511bce8415f'} Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:57:56.331523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.332822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.334129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Returning 404 to user: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:57:56.334129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-db5afa7e-f4ad-4024-a77a-a5d23d715e01 tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 404 len: 111 microversion: 2.1 time: 0.045743 Aug 09 17:57:56.337120 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 125/262] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 17:57:56 2022] DELETE /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:57:56.342649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:56.343294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] [instance: 4e743b93-99bc-4ef2-884d-7511bce8415f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:56.349399 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.350626 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.351105 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.351824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.352281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.352707 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.367422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] HTTP exception thrown: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Request method failure captured: Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f HTTP/1.1 Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_F5MycUfL2PWVpD6lhcz0KNKDR9GXSpwp2EW_dP6_eP8Qq6laITYLY6hATTYrva1fhDQ22wUrbAPmGC-x_GIQ7mwbeg_VZJyBcDRBK8ofUb-RIt9ZrD_m6KWPw1XMphc7w42HMatOd73xs2iDNllkXbrx-x2rd4bygp-JHvTIQvPE Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 17:57:56.369084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7eada23fab4b428e8dd7be1738cea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7eada23fab4b428e8dd7be1738cea5", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: dc7eada23fab4b428e8dd7be1738cea5 Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086879841 Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: e18740d304014f8caa523b5d41500140 Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-DeleteServersTestJSON-1086879841-project Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.370517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '4e743b93-99bc-4ef2-884d-7511bce8415f'} Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:57:56.371368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. Aug 09 17:57:56.372653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:57:56.375151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] Returning 404 to user: Instance 4e743b93-99bc-4ef2-884d-7511bce8415f could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:57:56.376300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5058629c-e69b-49b7-9ac4-928692ba165f tempest-DeleteServersTestJSON-1086879841 tempest-DeleteServersTestJSON-1086879841-project] 10.222.0.52 "GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f" status: 404 len: 111 microversion: 2.1 time: 0.037908 Aug 09 17:57:56.377314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 126/263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:56 2022] GET /compute/v2.1/servers/4e743b93-99bc-4ef2-884d-7511bce8415f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:57:56.426419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:56.427063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:56.433045 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.433536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.433851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:56.434181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.434893 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.435380 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.435812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.448704 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ed740aac-e8ed-40ac-b298-3fee6d164670 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.199214 Aug 09 17:57:56.450694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 138/264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:56 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:56.583091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:56.591801 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-eb890eca-4cc2-4832-81da-ed608cdd9505 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.169632 Aug 09 17:57:56.593035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 127/265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:56 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:57.470462 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:57.471231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:57.478258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:57.478795 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:57.479293 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:57.479980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:57.480630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:57.481923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:57.616204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:57.616902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:57.634075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:57.634737 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:57.635277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:57.639713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:57.641220 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:57.647729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:57.778837 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:57.792573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cf960a94-e5ca-4d47-9580-e1bd480b0833 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.325901 Aug 09 17:57:57.796083 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 139/266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:57 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:57.913967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:57.926422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-95e56137-96dc-496f-8423-f00279117819 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.313604 Aug 09 17:57:57.927479 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 128/267] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:57 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:58.825261 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:58.826454 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:58.828590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:58.829252 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:58.835612 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:58.836092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:58.836527 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:58.837222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:58.837681 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:58.838106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:58.947251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:58.948496 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:58.951895 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:58.956905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:58.957571 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:58.958013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:58.959100 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:58.960006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:58.960644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:59.050042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:59.063454 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-04fa6742-7e4b-448f-9345-cc5099bf10e1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.241877 Aug 09 17:57:59.064306 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 140/268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:58 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:59.189422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:59.196955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b1f17ca8-185a-4fef-a55c-3839c843ade5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.253694 Aug 09 17:57:59.197915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 129/269] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:58 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:00.089896 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:00.093270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:00.102918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:00.106497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:00.107032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:00.107868 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:00.108615 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:00.109110 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:00.225546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:00.226323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:00.233215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:00.233937 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:00.234443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:00.235240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:00.235973 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:00.236493 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:00.361825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:00.371411 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ee89af27-6fa8-4555-b942-b733415c4fd1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.289220 Aug 09 17:58:00.373939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 141/270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:00 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:00.445934 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:00.456525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2ff90357-59ea-4303-8db3-28317bcf04ef tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.239012 Aug 09 17:58:00.470908 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 130/271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:00 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:01.394541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:01.395741 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:01.403336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:01.403820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:01.404375 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:01.405077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:01.405525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:01.405954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:01.476914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:01.477528 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:01.484680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:01.485171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:01.485619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:01.486323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:01.486775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:01.487227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:01.581937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:01.589510 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-616b19f0-5e01-49f2-b70a-d5bcb98e8d63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.199741 Aug 09 17:58:01.590130 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 142/272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:01 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:01.642930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:01.650696 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ccc98909-6185-4185-8c88-4fc066993dcf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.177722 Aug 09 17:58:01.651481 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 131/273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:01 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:02.542472 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-9e5b9a6b-4304-4906-8671-5e53345928bb req-3205bf89-1fb5-4abf-89c1-6d2ee17f6563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7d15c2-3dd8-4695-a8fb-410b8d55b69d", "name": "network-vif-plugged", "status": "completed", "tag": "9aa78aea-4c2a-45dc-b9c0-fb36364eb873"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:02.552837 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9e5b9a6b-4304-4906-8671-5e53345928bb req-3205bf89-1fb5-4abf-89c1-6d2ee17f6563 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:02.553314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9e5b9a6b-4304-4906-8671-5e53345928bb req-3205bf89-1fb5-4abf-89c1-6d2ee17f6563 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:02.553771 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9e5b9a6b-4304-4906-8671-5e53345928bb req-3205bf89-1fb5-4abf-89c1-6d2ee17f6563 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:02.565450 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-9e5b9a6b-4304-4906-8671-5e53345928bb req-3205bf89-1fb5-4abf-89c1-6d2ee17f6563 service nova] Creating event network-vif-plugged:9aa78aea-4c2a-45dc-b9c0-fb36364eb873 for instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d on hv-cinder-83608 Aug 09 17:58:02.570327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-9e5b9a6b-4304-4906-8671-5e53345928bb req-3205bf89-1fb5-4abf-89c1-6d2ee17f6563 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Aug 09 17:58:02.570919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 143/274] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:02.613617 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:02.614344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:02.621798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:02.622580 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:02.622729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:02.623761 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:02.624220 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:02.624643 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:02.671743 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:02.672355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:02.679180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:02.679658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:02.680080 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:02.680758 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:02.681201 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:02.681668 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:03.031952 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:03.039799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-185851cb-fb43-4bd0-90d2-063b1a070fc7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1523 microversion: 2.1 time: 0.432876 Aug 09 17:58:03.040360 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 132/275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:02 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:03.045691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c87ccd3-5cb2-4de0-85ad-4d04c9805b69 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c06ae2ca0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:03.072145 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:03.080778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7feb4387-a495-4f82-98a6-19e0d1a8e6c1 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.413527 Aug 09 17:58:03.081813 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 144/276] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:02 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:03.097482 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c87ccd3-5cb2-4de0-85ad-4d04c9805b69 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b441012c-15b9-4f05-a50d-95f43d7d0cc4" status: 200 len: 351 microversion: 2.1 time: 0.055879 Aug 09 17:58:03.098061 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 133/277] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 17:58:03 2022] GET /compute/v2.1/os-volumes/b441012c-15b9-4f05-a50d-95f43d7d0cc4 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:04.062385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:04.062909 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:04.068870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.069342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.069773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.070453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.070895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.071334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.105905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:04.106627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:04.113116 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.113604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.114042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.114747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.115228 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.115656 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.247884 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:04.255685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-81b862c1-afb1-48dd-8419-0261d6d553a8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1503 microversion: 2.1 time: 0.197867 Aug 09 17:58:04.256255 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 145/278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:04 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:04.275348 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:04.276087 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:04.278613 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:04.283169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.283653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.284089 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.284776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.285222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.285638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.286028 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a50e7ce1-a2b9-4da9-aece-6a2885a0a8cf tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.185054 Aug 09 17:58:04.286605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 134/279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:04 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:04.419284 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:04.426846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-72fe68c6-b7ab-49a2-b2cd-c6cdb22db1ee tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1516 microversion: 2.1 time: 0.155416 Aug 09 17:58:04.427453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 146/280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:04 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:04.428843 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0152a839-c151-422d-875f-adbd7ed4e757 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c06ae2af0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:04.476083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0152a839-c151-422d-875f-adbd7ed4e757 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/de3cbc94-5a11-4ccb-b4dd-fb6e7ebd2cfd" status: 200 len: 351 microversion: 2.1 time: 0.051127 Aug 09 17:58:04.476662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 135/281] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 17:58:04 2022] GET /compute/v2.1/os-volumes/de3cbc94-5a11-4ccb-b4dd-fb6e7ebd2cfd => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:05.307339 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:05.307861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:05.314063 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.314600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.315145 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:05.315845 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.316324 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.316746 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:05.446780 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:05.455088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dae81fbc-a018-4bcc-b4b8-e812961372a9 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1314 microversion: 2.1 time: 0.151717 Aug 09 17:58:05.455648 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 147/282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:05 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:05.810267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:05.812540 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:05.819422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.819929 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.820410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:05.821097 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.821539 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.821955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:05.846543 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-58c12326-8d82-4f57-b0a1-b8192eeaafa6 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c06ada700>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:05.847532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'flavor' on Instance uuid c49d1e42-20f2-496b-bf4b-14348388eccb {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:58:05.896348 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-58c12326-8d82-4f57-b0a1-b8192eeaafa6 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3baef762-779d-4c33-b7c9-c45501d59b9e" status: 200 len: 350 microversion: 2.1 time: 0.053571 Aug 09 17:58:05.896925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 148/283] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 17:58:05 2022] GET /compute/v2.1/os-volumes/3baef762-779d-4c33-b7c9-c45501d59b9e => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:05.909377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-28fe3ff2-7f81-4b66-a7f1-18ca5079765c tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c08d540d0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:05.923562 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dd7d6f37-560c-4fa5-a56f-e96597e713c4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb/action" status: 200 len: 32 microversion: 2.1 time: 0.118055 Aug 09 17:58:05.924096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 136/284] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 17:58:05 2022] POST /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:58:05.933945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:05.934799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:05.940881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.941365 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.941802 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:05.942489 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.942945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.943393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:05.961823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:05.993643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-28fe3ff2-7f81-4b66-a7f1-18ca5079765c tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087896 Aug 09 17:58:05.994229 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 149/285] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Aug 9 17:58:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:06.008330 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d8f6faad-6eca-4168-8b2e-182513ea75ca tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c06ca5790>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.085004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:06.093129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2c6c384c-8961-477c-be82-3e845c86f1b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.163577 Aug 09 17:58:06.093599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d8f6faad-6eca-4168-8b2e-182513ea75ca tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089035 Aug 09 17:58:06.093707 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 137/286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:05 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:06.094173 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 150/287] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:06.107567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3715c49e-4f0e-4990-be4c-c5d5d8bd6fce tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c07dbca60>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.191825 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3715c49e-4f0e-4990-be4c-c5d5d8bd6fce tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088578 Aug 09 17:58:06.192398 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 138/288] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:06.205152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-153f4980-d0b3-42ff-8f03-b2a6709f6f25 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c06c7ec10>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.288792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-153f4980-d0b3-42ff-8f03-b2a6709f6f25 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087278 Aug 09 17:58:06.289368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 151/289] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:06.303252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bb50b64b-bd8d-45cd-b02d-8b757b999dec tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c069ee280>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.392861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bb50b64b-bd8d-45cd-b02d-8b757b999dec tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093504 Aug 09 17:58:06.393445 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 139/290] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:06.406992 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b96975a5-2271-46b0-aaa6-67154f87189e tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c07d85040>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.476389 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.477283 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:06.485089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:06.485585 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:06.486017 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:06.486922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:06.487455 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:06.487890 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:06.492879 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b96975a5-2271-46b0-aaa6-67154f87189e tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090113 Aug 09 17:58:06.493463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 152/291] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:06.507067 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-69555409-4ba5-4ee5-a53b-309758f5bc03 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c06bc5dc0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.590442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-69555409-4ba5-4ee5-a53b-309758f5bc03 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086730 Aug 09 17:58:06.591351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 153/292] 10.222.0.52 () {58 vars in 1188 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:06.604187 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-778c4ab1-dccb-4ff8-9fa7-e3d1ff9f0541 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] Calling method '.version_select at 0x7f8c06cf0940>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:06.687676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-778c4ab1-dccb-4ff8-9fa7-e3d1ff9f0541 tempest-VolumesTestJSON-208490051 tempest-VolumesTestJSON-208490051-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087104 Aug 09 17:58:06.688254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 154/293] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:06.701260 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:06.709542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-56322c8c-85ba-43f5-9c13-cbd910526f62 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1497 microversion: 2.1 time: 0.236980 Aug 09 17:58:06.710363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 140/294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:06 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1497 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:07.113585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:07.114204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:07.116212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:07.121637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.122128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.122628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.123294 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.124011 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.124433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.264336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:07.271797 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b7efc7e1-b8d6-471b-8b3e-4bbf3d381d83 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.162129 Aug 09 17:58:07.272355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 155/295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:07 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:07.406831 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:07.407359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:07.417847 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.418713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.419812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.421043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.421876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.422629 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.449944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:58:07.529623 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ee8e79cf-b7cb-497f-8d32-9916fe58ef52 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 204 len: 0 microversion: 2.1 time: 0.126368 Aug 09 17:58:07.530224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 141/296] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 17:58:07 2022] DELETE /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:58:07.540046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:07.540664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:07.546879 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.547399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.547835 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.548520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.548972 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.549397 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.682374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:07.690526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7f4b214a-d167-4410-b145-b448b19db47f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1503 microversion: 2.1 time: 0.155620 Aug 09 17:58:07.691115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 156/297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:07 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:08.295192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:08.295192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:08.296864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:08.302405 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:08.302889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:08.303352 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:08.304042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:08.304489 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:08.304910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:08.435173 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:08.442590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-abd3d2ba-8a0a-4ccf-8732-78bdce769712 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.153117 Aug 09 17:58:08.443190 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 142/298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:08 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:08.711698 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:08.712310 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:08.718757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:08.719267 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:08.719697 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:08.720374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:08.720816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:08.721227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:08.849579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:08.857599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-34e6a338-df0f-4414-be91-354a8ccea14b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1503 microversion: 2.1 time: 0.149770 Aug 09 17:58:08.858165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 157/299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:08 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:09.462566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:09.463212 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:09.470183 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:09.470666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:09.471131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:09.471813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:09.472291 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:09.472710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:09.607868 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:09.615235 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-09c5744c-c889-4f00-85b0-2fe326f4db62 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.156484 Aug 09 17:58:09.615804 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 143/300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:09 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:09.878738 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:09.879368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:09.885260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:09.885735 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:09.886166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:09.886846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:09.887326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:09.887745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:10.060941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:10.068731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-87a2e511-034e-420d-8393-85a783f4a47a tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1503 microversion: 2.1 time: 0.193743 Aug 09 17:58:10.070803 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 158/301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:09 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:10.542546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-e5781b2c-2993-4eac-94bd-941a12f59d9f req-2400b373-e40a-4813-85ae-fc23930b06bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7d15c2-3dd8-4695-a8fb-410b8d55b69d", "name": "network-vif-deleted", "tag": "9aa78aea-4c2a-45dc-b9c0-fb36364eb873"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:10.553552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e5781b2c-2993-4eac-94bd-941a12f59d9f req-2400b373-e40a-4813-85ae-fc23930b06bd service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:10.554202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e5781b2c-2993-4eac-94bd-941a12f59d9f req-2400b373-e40a-4813-85ae-fc23930b06bd service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:10.554805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e5781b2c-2993-4eac-94bd-941a12f59d9f req-2400b373-e40a-4813-85ae-fc23930b06bd service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:10.566669 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-e5781b2c-2993-4eac-94bd-941a12f59d9f req-2400b373-e40a-4813-85ae-fc23930b06bd service nova] Creating event network-vif-deleted:9aa78aea-4c2a-45dc-b9c0-fb36364eb873 for instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d on hv-cinder-83608 Aug 09 17:58:10.572683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-e5781b2c-2993-4eac-94bd-941a12f59d9f req-2400b373-e40a-4813-85ae-fc23930b06bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033489 Aug 09 17:58:10.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 144/302] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:10.637666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:10.638289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:10.645486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:10.645961 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:10.646580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:10.647506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:10.647955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:10.648364 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:10.818962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:10.830955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71368e2f-8ffb-4f3f-900d-6264b4149fdb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.197014 Aug 09 17:58:10.831598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 159/303] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:10 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:11.089911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:11.090615 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:11.097630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.098129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.098568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:11.099337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.099976 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.100605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:11.133590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.134080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.134510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:11.134961 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lazy-loading 'fault' on Instance uuid 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:58:11.186705 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:11.194992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ce2c492a-af64-4124-b366-9c7454bb7055 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 200 len: 1304 microversion: 2.1 time: 0.109294 Aug 09 17:58:11.195591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 145/304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:11 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:11.853319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:11.854222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:11.862752 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.863296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.863893 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:11.864585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.865226 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.865805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:12.031857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:12.039621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8a6b9a36-aba9-4a7b-b7df-ea4cdfbe2941 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.190105 Aug 09 17:58:12.040768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 160/305] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:11 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:12.217702 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:12.218311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:12.224679 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:12.225160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:12.225590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:12.226275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:12.226720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:12.227163 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:12.242958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] HTTP exception thrown: Instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d could not be found. Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Request method failure captured: Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d HTTP/1.1 Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qAZj9iRgGQ0bRkObM6n-uL9FPBg6NJr6vp6wDxsLNX9oA8WqkhMoXDqKXmSYKVK_oKSIKTv2p7dJuefU3-UjO9gK0n31ql7JEbOZpP3rgjKcQjoU8nnFgPoaJOPNEMaynr1-mUy0N5OzhxoJGGffF19shCFseWVi8U4OQaPzcp1hNU Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: c00730b67ae04f58be1322a80cc6a4c2 Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesActionsTest-989948079 Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 17:58:12.244969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c00730b67ae04f58be1322a80cc6a4c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c00730b67ae04f58be1322a80cc6a4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c00730b67ae04f58be1322a80cc6a4c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c00730b67ae04f58be1322a80cc6a4c2", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesActionsTest-989948079 Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: c00730b67ae04f58be1322a80cc6a4c2 Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesActionsTest-989948079 Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesActionsTest-989948079-project Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: ff0c1d9939374d14bbc7cacad41162ea Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesActionsTest-989948079-project Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d could not be found. Aug 09 17:58:12.246224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '6c7d15c2-3dd8-4695-a8fb-410b8d55b69d'} Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d could not be found. Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:58:12.247030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d could not be found. Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d could not be found. Aug 09 17:58:12.248112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:12.249341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Returning 404 to user: Instance 6c7d15c2-3dd8-4695-a8fb-410b8d55b69d could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:58:12.249341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b5fa9f1c-8072-45ad-9895-71b1b6883039 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d" status: 404 len: 111 microversion: 2.1 time: 0.033409 Aug 09 17:58:12.249341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 146/306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:12 2022] GET /compute/v2.1/servers/6c7d15c2-3dd8-4695-a8fb-410b8d55b69d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:58:12.364367 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1384248166", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "networks": [{"uuid": "74ef389c-b413-4ad8-b86e-27ca15635e59"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:12.429079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] validate_networks() for [('74ef389c-b413-4ad8-b86e-27ca15635e59', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:58:12.803967 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:12.804379 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:12.804842 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:12.805240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:12.805643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:12.814995 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:12.815473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:12.815898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:12.816604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:12.817251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:12.817679 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:12.834267 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Getting quotas for project c00730b67ae04f58be1322a80cc6a4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:12.838274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Getting quotas for user ff0c1d9939374d14bbc7cacad41162ea and project c00730b67ae04f58be1322a80cc6a4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:12.854766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:58:12.859543 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:58:12.909223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5041bb4b-2410-4ac7-8d65-68fc597eb354 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548629 Aug 09 17:58:12.910844 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 161/307] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:58:12.922946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6d0fd168-d921-4cf6-87b3-0126b914c923 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:12.924214 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6d0fd168-d921-4cf6-87b3-0126b914c923 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:13.011256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6d0fd168-d921-4cf6-87b3-0126b914c923 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:13.018280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6d0fd168-d921-4cf6-87b3-0126b914c923 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1214 microversion: 2.1 time: 0.100698 Aug 09 17:58:13.019113 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 147/308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:12 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:13.062258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:13.062884 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:13.077190 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:13.077691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:13.078125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:13.079033 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:13.079646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:13.080232 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:13.275639 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:13.292463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-26ea095d-24f9-4231-abc0-4f85ff7d5713 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.234903 Aug 09 17:58:13.301854 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 162/309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:13 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:14.038655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:14.039415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:14.066829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.067645 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.068338 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.070008 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.070687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.071428 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.179702 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:14.188160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d188d1bc-c0af-444f-9582-0d83b01d6da8 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1274 microversion: 2.1 time: 0.153303 Aug 09 17:58:14.189226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 148/310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:14 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:14.317353 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:14.318629 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:14.325442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.325733 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.326166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.327109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.327926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.328723 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.333611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:14.630469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:14.638379 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4550122f-a1d6-4410-ae38-e01d3c114eec tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.325836 Aug 09 17:58:14.638960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 163/311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:14 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:15.210087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:15.211359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:15.218750 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:15.219491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:15.219924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:15.220628 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:15.221072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:15.221490 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:15.661469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:15.661915 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:15.668916 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:15.669686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:15.670178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:15.670997 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:15.671547 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:15.672079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:15.714563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:15.722154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e07708fa-be98-4c48-a0a7-5a09a4be9cc0 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.515976 Aug 09 17:58:15.723375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 149/312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:15 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:15.881192 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:15.889447 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2bc61ac6-5a67-4cb9-bb4a-6a8072822f34 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.233245 Aug 09 17:58:15.890023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 164/313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:15 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:16.111961 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-802cccf9-fd19-4615-b8ec-cff0c85fe948 req-192b12bc-49b6-420f-b728-bcda5748677e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d98d220-272b-44fc-9779-c1b19296ca63", "tag": "01eb7c5b-5025-48ef-8301-7a51ffe82ece"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:16.123044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-802cccf9-fd19-4615-b8ec-cff0c85fe948 req-192b12bc-49b6-420f-b728-bcda5748677e service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:16.124113 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-802cccf9-fd19-4615-b8ec-cff0c85fe948 req-192b12bc-49b6-420f-b728-bcda5748677e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:16.124785 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-802cccf9-fd19-4615-b8ec-cff0c85fe948 req-192b12bc-49b6-420f-b728-bcda5748677e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:16.139601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-802cccf9-fd19-4615-b8ec-cff0c85fe948 req-192b12bc-49b6-420f-b728-bcda5748677e service nova] Creating event network-changed:01eb7c5b-5025-48ef-8301-7a51ffe82ece for instance 0d98d220-272b-44fc-9779-c1b19296ca63 on hv-cinder-83608 Aug 09 17:58:16.145739 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-802cccf9-fd19-4615-b8ec-cff0c85fe948 req-192b12bc-49b6-420f-b728-bcda5748677e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041263 Aug 09 17:58:16.146795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 150/314] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:16.743973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:16.744584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:16.751628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:16.752223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:16.752662 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:16.753347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:16.753792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:16.754212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:16.884793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:16.892691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-161bee61-a1b1-4ff4-8358-6d62991f8c1f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.152659 Aug 09 17:58:16.893325 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 165/315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:16 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:16.913108 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:16.913108 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:16.918811 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:16.919331 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:16.919769 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:16.920466 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:16.920916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:16.921349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:17.060786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:17.068454 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fa55d9f3-9609-4a3a-a317-e39d4997fef4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.161307 Aug 09 17:58:17.069154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 151/316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:16 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:17.913592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:17.914209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:17.920900 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:17.921384 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:17.921807 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:17.922486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:17.922929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:17.923372 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:18.052241 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:18.059900 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1694c0ee-a43d-4bda-8143-9ab0b190fade tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.150087 Aug 09 17:58:18.060470 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 166/317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:17 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:18.089564 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:18.090903 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:18.098449 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:18.099201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:18.099642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:18.100354 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:18.100806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:18.101230 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:18.331502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:18.339129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-08891cab-818d-4239-a58d-809466c641f7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.253368 Aug 09 17:58:18.340570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 152/318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:18 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:19.081166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:19.082352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:19.088791 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:19.089360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:19.090023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:19.090957 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:19.091491 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:19.092148 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:19.227225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:19.235169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fe5c5f51-3dfc-42a1-a3e4-ab7fbe7395a6 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.158238 Aug 09 17:58:19.235756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 167/319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:19 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:19.361282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:19.361907 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:19.368633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:19.369118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:19.369555 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:19.370249 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:19.370701 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:19.371177 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:19.500193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:19.508884 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4bf36ca5-6022-48aa-80d3-efdb42da063f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.151378 Aug 09 17:58:19.509486 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 153/320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:19 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:20.255653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:20.256263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:20.262724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:20.263242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:20.263667 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:20.264343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:20.264791 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:20.265208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:20.400347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:20.408082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1d2b1af6-1418-42a5-9290-ca0190035120 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.156197 Aug 09 17:58:20.408658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 168/321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:20 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:20.530443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:20.531096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:20.537477 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:20.537970 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:20.538409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:20.539141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:20.539599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:20.540027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:20.698642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:20.707010 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e7068375-9be0-4506-93e4-c198803bcf63 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.180377 Aug 09 17:58:20.707619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 154/322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:20 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:21.433497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:21.434676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:21.440641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:21.441115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:21.441544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:21.442229 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:21.442674 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:21.443123 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:21.576539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:21.583876 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2dc86d2e-c4e4-41c8-bf62-b128db65d550 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.154451 Aug 09 17:58:21.584438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 169/323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:21 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:21.741441 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:21.741963 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:21.749124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:21.749607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:21.750046 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:21.750733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:21.751218 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:21.751646 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:21.892894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:21.900423 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a464343e-66ce-4791-a316-1907041576f6 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.163107 Aug 09 17:58:21.900993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 155/324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:21 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:22.604148 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:22.604792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:22.610767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:22.611279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:22.611717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:22.612402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:22.612852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:22.613278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:22.743960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:22.751620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4f05c547-b750-4143-80f9-3e88ad701e44 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.151346 Aug 09 17:58:22.752195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 170/325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:22 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:22.921146 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:22.921773 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:22.928396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:22.928889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:22.929335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:22.930033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:22.930490 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:22.930917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:23.018173 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:23.060054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:23.068226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4a1f8ac0-2436-4f8a-80b7-7a631c59658c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.150893 Aug 09 17:58:23.068791 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 156/326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:22 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:23.772637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:23.773246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:23.775099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:23.775788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:23.781852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:23.782332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:23.782765 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:23.783477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:23.783929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:23.784351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:23.912264 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:23.922333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2c681f46-76bb-47ff-83ac-8111c0a3744b tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.153435 Aug 09 17:58:23.923627 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 171/327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:23 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:24.089599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:24.090340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:24.096727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:24.097209 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:24.097644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:24.098325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:24.098777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:24.099222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:24.103202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:24.232072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:24.239517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-07f62211-ec2b-4a62-a01a-2f89a00b8c61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.153801 Aug 09 17:58:24.240093 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 157/328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:24 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:24.945601 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:24.946375 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:24.957991 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:24.958467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:24.958892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:24.959603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:24.960045 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:24.960457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:25.091580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:25.099172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec2f2fe9-007d-4d4f-9ed3-bc5e161d52ec tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.159716 Aug 09 17:58:25.099748 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 172/329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:24 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:25.260658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:25.261278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:25.268348 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:25.268834 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:25.269274 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:25.269965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:25.270422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:25.270848 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:25.413570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:25.421723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ca862ac4-87e0-4983-951e-d1b5ba1a0362 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.164915 Aug 09 17:58:25.422391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 158/330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:25 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:25.902623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-63c28119-5f1e-4cb2-8952-24b647ca87ae req-e801b295-2803-458f-ad36-e54369319047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d98d220-272b-44fc-9779-c1b19296ca63", "name": "network-vif-plugged", "status": "completed", "tag": "01eb7c5b-5025-48ef-8301-7a51ffe82ece"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:25.912385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-63c28119-5f1e-4cb2-8952-24b647ca87ae req-e801b295-2803-458f-ad36-e54369319047 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:25.912933 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-63c28119-5f1e-4cb2-8952-24b647ca87ae req-e801b295-2803-458f-ad36-e54369319047 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:25.913542 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-63c28119-5f1e-4cb2-8952-24b647ca87ae req-e801b295-2803-458f-ad36-e54369319047 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:25.925387 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-63c28119-5f1e-4cb2-8952-24b647ca87ae req-e801b295-2803-458f-ad36-e54369319047 service nova] Creating event network-vif-plugged:01eb7c5b-5025-48ef-8301-7a51ffe82ece for instance 0d98d220-272b-44fc-9779-c1b19296ca63 on hv-cinder-83608 Aug 09 17:58:25.930269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-63c28119-5f1e-4cb2-8952-24b647ca87ae req-e801b295-2803-458f-ad36-e54369319047 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Aug 09 17:58:25.931044 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 173/331] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:26.120092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:26.120701 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:26.127640 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:26.128207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:26.129054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:26.129322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:26.129764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:26.130179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:26.232832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:26.233417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:26.239633 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:26.240124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:26.240560 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:26.241254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:26.241707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:26.242129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:26.264936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7f7d2681-a0b1-4089-8789-b2771a4b8d6c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/ips" status: 200 len: 146 microversion: 2.1 time: 0.036789 Aug 09 17:58:26.265417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 174/332] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 17:58:26 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:26.279815 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:26.287138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-70087bc8-7d5f-4855-956a-4c52db88b6b7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.171423 Aug 09 17:58:26.287699 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 159/333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:26 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:26.442336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:26.442949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:26.449269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:26.450270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:26.450756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:26.451499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:26.451957 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:26.452399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:26.591968 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:26.599484 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc379e8b-b89e-45a0-af6d-b0fb36386ab7 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.160988 Aug 09 17:58:26.600042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 175/334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:26 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:27.308009 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:27.309480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:27.316362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:27.316843 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:27.317278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:27.317970 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:27.318419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:27.318892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:27.447497 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:27.455501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8b7a7423-fe2e-49e7-ae60-29e4df0f8df7 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1314 microversion: 2.1 time: 0.151421 Aug 09 17:58:27.456076 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 160/335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:27 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:27.620091 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:27.620731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:27.626839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:27.627349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:27.627780 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:27.628463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:27.628912 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:27.629329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:27.764276 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:27.771667 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05e554c3-0533-4fa2-8a17-e9ef8df4f1dd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.155378 Aug 09 17:58:27.772237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 176/336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:27 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:28.475396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:28.476015 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:28.482224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:28.482716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:28.483427 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:28.484138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:28.484592 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:28.485022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:28.632664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:28.640584 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2bbf3fe7-b8b5-4a7e-bda2-9fee780a355d tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1497 microversion: 2.1 time: 0.168892 Aug 09 17:58:28.641167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 161/337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:28 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:28.794046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:28.794664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:28.801910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:28.802392 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:28.802874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:28.803617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:28.804123 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:28.804536 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:28.953962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:28.967661 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-04569527-f6c2-4eb0-a4a2-51fce1fdb6a2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.177861 Aug 09 17:58:28.971027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 177/338] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:28 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:29.192152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:29.192666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:29.199029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:29.199561 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:29.199997 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:29.200710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:29.201167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:29.201592 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:29.227491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:58:29.323008 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ddc9ab79-7a04-4867-8b86-0becc5d81dd5 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 204 len: 0 microversion: 2.1 time: 0.138448 Aug 09 17:58:29.323636 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 162/339] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 17:58:29 2022] DELETE /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:58:29.333194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:29.333805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:29.341942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:29.342461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:29.342896 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:29.343625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:29.344077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:29.344502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:29.546105 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:29.553931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8d37d6e6-2ca8-44c0-86b6-b72d72596ffe tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1503 microversion: 2.1 time: 0.225128 Aug 09 17:58:29.554718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 178/340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:29 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:29.989220 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:29.989912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:29.996289 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:29.997193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:29.997193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:29.997869 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:29.998322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:29.999043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:30.136627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:30.144899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bb66e1e9-13aa-4796-a4f5-18a9eadd4b41 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.159856 Aug 09 17:58:30.145893 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 163/341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:29 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:30.580444 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:30.581066 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:30.583451 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "801dca03-93e2-4aa1-9d9f-6ec6c4c2611b"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:30.585775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:30.586928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:30.587430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:30.587855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:30.588540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:30.588985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:30.589402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:30.591918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:30.592409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:30.592849 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:30.593546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:30.594166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:30.594752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:30.727212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:30.736315 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d56cb7ac-342b-4362-843e-5be027cc6bde tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1503 microversion: 2.1 time: 0.159516 Aug 09 17:58:30.736894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 179/342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:30 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:31.165605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:31.166209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:31.172530 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:31.173067 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:31.173415 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:31.174093 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:31.174542 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:31.178518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:31.320213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:31.324034 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:31.329401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93275508-8122-4160-9f9e-8481366266e3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.167643 Aug 09 17:58:31.329983 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 180/343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:31 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:31.758641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:31.759403 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:31.766656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:31.767265 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:31.767770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:31.768486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:31.768921 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:31.769359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:31.943664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:31.952545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8f9f8880-9bb3-42db-b542-814b86c0518f tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1503 microversion: 2.1 time: 0.198732 Aug 09 17:58:31.953075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 181/344] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:31 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:32.356293 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:32.359769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:32.369777 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:32.370430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:32.371240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:32.372814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:32.373269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:32.373688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:32.452847 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-73af76c4-ec54-4218-8c30-1da300ab0e34 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.873030 Aug 09 17:58:32.454045 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 164/345] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 17:58:30 2022] POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-volume_attachments => generated 194 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:32.518103 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:32.535085 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d8891118-8c86-4c8b-b69a-f2480bda1355 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.179898 Aug 09 17:58:32.535521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 182/346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:32 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:32.975296 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:32.976005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:32.983308 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:32.983791 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:32.984225 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:32.984918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:32.985368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:32.985809 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:33.237259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:33.246068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b729862-bd56-4987-9785-54f234acec68 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1503 microversion: 2.1 time: 0.276413 Aug 09 17:58:33.247694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 165/347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:32 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:33.552022 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:33.552022 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:33.561776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:33.562308 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:33.562740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:33.563479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:33.564756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:33.565179 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:33.612827 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-6d7e5039-49f9-4ddb-8d08-d1039b868cc1 req-949eb8b5-0295-4c0e-b913-73e7a311b246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d98d220-272b-44fc-9779-c1b19296ca63", "name": "network-vif-deleted", "tag": "01eb7c5b-5025-48ef-8301-7a51ffe82ece"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:33.632571 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6d7e5039-49f9-4ddb-8d08-d1039b868cc1 req-949eb8b5-0295-4c0e-b913-73e7a311b246 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:33.636686 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6d7e5039-49f9-4ddb-8d08-d1039b868cc1 req-949eb8b5-0295-4c0e-b913-73e7a311b246 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:33.637732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6d7e5039-49f9-4ddb-8d08-d1039b868cc1 req-949eb8b5-0295-4c0e-b913-73e7a311b246 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:33.653747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-6d7e5039-49f9-4ddb-8d08-d1039b868cc1 req-949eb8b5-0295-4c0e-b913-73e7a311b246 service nova] Creating event network-vif-deleted:01eb7c5b-5025-48ef-8301-7a51ffe82ece for instance 0d98d220-272b-44fc-9779-c1b19296ca63 on hv-cinder-83608 Aug 09 17:58:33.661068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-6d7e5039-49f9-4ddb-8d08-d1039b868cc1 req-949eb8b5-0295-4c0e-b913-73e7a311b246 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051867 Aug 09 17:58:33.662047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 166/348] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:33.756508 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:33.765740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-07dc4312-9b1f-4c8e-bced-428426dab6ef tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.220452 Aug 09 17:58:33.766334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 183/349] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:33 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:34.269620 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:34.270709 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:34.278342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:34.278922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:34.279381 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.280146 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:34.280599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:34.281028 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.316283 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:34.316769 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:34.317215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.317664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lazy-loading 'fault' on Instance uuid 0d98d220-272b-44fc-9779-c1b19296ca63 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:58:34.370178 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c1d9939374d14bbc7cacad41162ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00730b67ae04f58be1322a80cc6a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:34.378826 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b7cd74a-ecf1-4910-8d55-d0c782a393a3 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 200 len: 1304 microversion: 2.1 time: 0.113383 Aug 09 17:58:34.379749 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 167/350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:34 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:34.785530 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:34.786208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:34.792000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:34.792470 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:34.792892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.793801 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:34.794415 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:34.794832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.935398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:34.943563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dda55ab3-6f21-454d-b8b4-a96b43bfd9b8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1502 microversion: 2.1 time: 0.161839 Aug 09 17:58:34.944266 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 184/351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:34 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:34.965537 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff50473a-45c7-42a1-84fa-a572eb14bd6b"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:34.967559 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:34.973396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:34.973871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:34.974299 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.975000 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:34.975628 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:34.976047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.999377 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] HTTP exception thrown: Cannot 'attach_volume' instance c49d1e42-20f2-496b-bf4b-14348388eccb while it is in vm_state rescued Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Request method failure captured: Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: POST /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb/os-volume_attachments HTTP/1.1 Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 74 Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_ENkpffXr2zSFxwPtM5XL1o7MLekOa5K8bYYPQiqjiHWveoX5QSNnPRZM-hoZhfIhsubxQJlulV7XFSpcLhF3owFmm14AcXqnzKD5Pu7E5WhY405oX6swzCqnqYPjAUYa9hAj1eoZohAVi8k209pGy_OpP64jT8E9usg9v29Jd6N4 Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 17:58:35.001317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13cf0de2979c44a08f500430834617d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13cf0de2979c44a08f500430834617d2", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: f7491479bd88425f8234e0b1d0e11e55 Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {"volumeAttachment": {"volumeId": "ff50473a-45c7-42a1-84fa-a572eb14bd6b"}} Aug 09 17:58:35.002764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Cannot 'attach_volume' instance c49d1e42-20f2-496b-bf4b-14348388eccb while it is in vm_state rescued Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'server_id': 'c49d1e42-20f2-496b-bf4b-14348388eccb', 'body': {'volumeAttachment': {'volumeId': 'ff50473a-45c7-42a1-84fa-a572eb14bd6b'}}} Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c49d1e42-20f2-496b-bf4b-14348388eccb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:58:35.003651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c49d1e42-20f2-496b-bf4b-14348388eccb while it is in vm_state rescued Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:35.005042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:35.006255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:58:35.006255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:58:35.006255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c49d1e42-20f2-496b-bf4b-14348388eccb while it is in vm_state rescued Aug 09 17:58:35.006255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.007211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Returning 409 to user: Cannot 'attach_volume' instance c49d1e42-20f2-496b-bf4b-14348388eccb while it is in vm_state rescued {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:58:35.008052 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c7be4422-ba27-4f4e-8aac-5aec13bd3435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047276 Aug 09 17:58:35.008606 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 168/352] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 17:58:34 2022] POST /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:58:35.018069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:35.018927 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:35.025290 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.026237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.026429 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.027162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.027878 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.028439 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.117405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9d7ac39d-48b3-4e4d-837f-cc30eddf141f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb/action" status: 202 len: 0 microversion: 2.1 time: 0.103114 Aug 09 17:58:35.118806 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 185/353] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 17:58:35 2022] POST /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:58:35.129135 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:35.129991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:35.137952 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.139012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.139706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.140676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.141385 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.142031 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.375834 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:35.383695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e07a589b-0153-4618-a25c-79ffb671195f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1510 microversion: 2.1 time: 0.259778 Aug 09 17:58:35.384280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 169/354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:35 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:35.401416 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:35.402326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] [instance: 0d98d220-272b-44fc-9779-c1b19296ca63] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:35.409747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.410435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.410863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.411588 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.412033 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.412448 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.429782 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] HTTP exception thrown: Instance 0d98d220-272b-44fc-9779-c1b19296ca63 could not be found. Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Request method failure captured: Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 HTTP/1.1 Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qAZj9iRgGQ0bRkObM6n-uL9FPBg6NJr6vp6wDxsLNX9oA8WqkhMoXDqKXmSYKVK_oKSIKTv2p7dJuefU3-UjO9gK0n31ql7JEbOZpP3rgjKcQjoU8nnFgPoaJOPNEMaynr1-mUy0N5OzhxoJGGffF19shCFseWVi8U4OQaPzcp1hNU Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: c00730b67ae04f58be1322a80cc6a4c2 Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesActionsTest-989948079 Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 17:58:35.431682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c00730b67ae04f58be1322a80cc6a4c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c00730b67ae04f58be1322a80cc6a4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c00730b67ae04f58be1322a80cc6a4c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c00730b67ae04f58be1322a80cc6a4c2", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesActionsTest-989948079 Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: c00730b67ae04f58be1322a80cc6a4c2 Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesActionsTest-989948079 Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesActionsTest-989948079-project Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: ff0c1d9939374d14bbc7cacad41162ea Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesActionsTest-989948079-project Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 0d98d220-272b-44fc-9779-c1b19296ca63 could not be found. Aug 09 17:58:35.432949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '0d98d220-272b-44fc-9779-c1b19296ca63'} Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d98d220-272b-44fc-9779-c1b19296ca63 could not be found. Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:58:35.433709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d98d220-272b-44fc-9779-c1b19296ca63 could not be found. Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d98d220-272b-44fc-9779-c1b19296ca63 could not be found. Aug 09 17:58:35.435239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 17:58:35.436451 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] Returning 404 to user: Instance 0d98d220-272b-44fc-9779-c1b19296ca63 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:58:35.436451 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-74ab08de-c567-413c-9bda-c4a1a4cfe358 tempest-VolumesActionsTest-989948079 tempest-VolumesActionsTest-989948079-project] 10.222.0.52 "GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63" status: 404 len: 111 microversion: 2.1 time: 0.036062 Aug 09 17:58:35.436451 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 186/355] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:35 2022] GET /compute/v2.1/servers/0d98d220-272b-44fc-9779-c1b19296ca63 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:58:36.405096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:36.405729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:36.412086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.412567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.412993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.413680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.414127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.414543 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.569731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:36.579674 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-93445c8d-8d16-4271-9d29-3d55b00d9a42 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1510 microversion: 2.1 time: 0.178264 Aug 09 17:58:36.580426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 170/356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:36 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:36.932801 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:36.933380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:36.940434 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.941564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.941564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.942179 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.942606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.943047 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.968980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9a949cc-e0a7-4fc4-94a5-b73d47719dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/ips" status: 200 len: 151 microversion: 2.20 time: 0.040431 Aug 09 17:58:36.975954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 187/357] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Aug 9 17:58:36 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:58:37.251278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:37.252483 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:37.267138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.267785 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.268297 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:37.269084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.269641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.270134 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:37.291772 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:37.304886 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0e791767-525f-4ab6-b3f3-dd51cf010202 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/ips" status: 200 len: 148 microversion: 2.1 time: 0.062953 Aug 09 17:58:37.305925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 171/358] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 17:58:37 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/ips => generated 148 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:37.609534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:37.610265 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:37.617666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:37.638296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.641208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.641931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:37.643634 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.644437 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.645748 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:37.804523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:37.812710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-87495ac7-77ba-4a47-b5ef-0eb5fc0fb68d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1510 microversion: 2.1 time: 0.208140 Aug 09 17:58:37.813269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 188/359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:37 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:38.835493 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:38.836098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:38.838713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:38.845642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:38.846131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:38.846565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:38.847282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:38.847729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:38.848148 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:38.982081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:38.989534 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-843028b5-5ef8-49f1-a86a-3a4cec56bedf tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1510 microversion: 2.1 time: 0.157912 Aug 09 17:58:38.990093 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 172/360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:38 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:40.010500 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:40.011710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:40.024435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.024929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.025975 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.026685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.027168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.027590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.163660 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:40.172929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ba94ab2e-e074-449d-955c-fd7da81c28ad tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1510 microversion: 2.1 time: 0.165995 Aug 09 17:58:40.173514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 189/361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:40 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:40.860925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d4299bc-f2d1-4106-86db-843990e24d5c"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:40.863344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:40.870136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.870651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.871108 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.871806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.872289 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.872709 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.177035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:41.177580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:41.184663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.185194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.185625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.186434 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.186913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.188869 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.213287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lazy-loading 'flavor' on Instance uuid ffe8c172-bab3-4a24-b716-1b536176ef81 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:58:41.486601 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-afc0137b-420d-4ef1-ba05-1be93d1211c7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/action" status: 202 len: 0 microversion: 2.20 time: 0.313168 Aug 09 17:58:41.488180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 190/362] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 9 17:58:41 2022] POST /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:58:41.494087 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:41.494949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:41.513106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.513669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.514105 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.518144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.519312 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.519773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.719363 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:41.731593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e85ec6ea-6243-40a3-91ae-7bfa36622a64 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1510 microversion: 2.1 time: 0.241276 Aug 09 17:58:41.732494 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 191/363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:41 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:41.737648 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:41.738710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:41.746042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.747211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.748431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.750137 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.751208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.751986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.850578 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-da448a58-7862-4f9e-b916-ad4541dd0f5a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.993120 Aug 09 17:58:41.852126 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 173/364] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 17:58:40 2022] POST /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:41.963866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:41.977117 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:41.978884 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:41.980546 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82a3e9ee-b7bd-4286-b6f0-4b3dfc3ea5fd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.246651 Aug 09 17:58:41.982279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 192/365] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:41 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:42.758755 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:42.760417 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:42.774671 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:42.775780 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:42.776816 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:42.778056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:42.779165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:42.780171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.080480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:43.081332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:43.107209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.107631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.108055 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.109024 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.109623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.110194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.439628 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:43.451709 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-816e7b01-5001-45d0-a52b-85df3d77a04a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1516 microversion: 2.1 time: 0.700357 Aug 09 17:58:43.463363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 174/366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:42 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1516 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:43.482000 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-27678f5b-e14d-4d06-9d35-005178234f7c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:43.489179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27678f5b-e14d-4d06-9d35-005178234f7c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.490005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27678f5b-e14d-4d06-9d35-005178234f7c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.490680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27678f5b-e14d-4d06-9d35-005178234f7c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.595965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-27678f5b-e14d-4d06-9d35-005178234f7c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Going to try to stop instance {{(pid=117885) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:58:43.658186 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:43.668259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:43.675672 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:43.677587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4aee0d3c-e8d6-4287-b9e7-a327b9adb351 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.652579 Aug 09 17:58:43.678561 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 193/367] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:43 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:43.718172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-27678f5b-e14d-4d06-9d35-005178234f7c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action" status: 202 len: 0 microversion: 2.1 time: 0.253073 Aug 09 17:58:43.718818 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 175/368] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 17:58:43 2022] POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:58:43.727565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:43.728115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:43.746590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.751410 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.752007 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.752885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.753261 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.753688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:44.003892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:44.018686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0177ed3e-7765-45d7-a648-ea59de3f9d5e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.295367 Aug 09 17:58:44.020326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 194/369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:43 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:44.707120 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:44.709554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:44.721222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:44.721901 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:44.722400 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:44.723267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:44.723872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:44.725074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:44.942805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:44.959173 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:44.962417 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:44.966292 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c3e0bf3-0cd9-4d39-8b00-33a0af195552 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.265712 Aug 09 17:58:44.967298 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 176/370] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:44 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:45.044168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:45.045207 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:45.054606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:45.055764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:45.056665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:45.057643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:45.058502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:45.059799 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:45.084524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:45.265926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:45.278509 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5b703e7c-b7d5-4586-a14c-17ab1e7e7223 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.240405 Aug 09 17:58:45.279541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 195/371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:45 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:45.292363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7eaf69df-4fb7-4e24-a310-4e5fea9b071e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'create', calling method: .version_select at 0x7f8c0698f160>, body: {"keypair": {"name": "tempest-keypair-330771617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZG4m5+jz838iLWOqzR3pDOWGTpSpa2+QKMurHlok+3uQ/0t+aMXqN19Euih+Px4nTIy/SzTssplrKEyY9T3OMxZelDul4Zui9ijur5Ev4n40vbb8hI2VnPMv7ufhryDg=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:45.312550 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-7eaf69df-4fb7-4e24-a310-4e5fea9b071e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for project 13cf0de2979c44a08f500430834617d2. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:45.319162 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-7eaf69df-4fb7-4e24-a310-4e5fea9b071e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for user f7491479bd88425f8234e0b1d0e11e55 and project 13cf0de2979c44a08f500430834617d2. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:45.358415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7eaf69df-4fb7-4e24-a310-4e5fea9b071e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072234 Aug 09 17:58:45.366410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 177/372] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 17:58:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:45.991856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:45.992675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:46.003271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.004040 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.004651 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.005518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.006146 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.006745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.272792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:46.284942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:46.287745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:46.289120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c4f27bdd-80dd-4dff-9a95-fb749462bf45 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.302404 Aug 09 17:58:46.289834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 196/373] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:45 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:46.308698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:46.309880 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:46.320670 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.321390 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.322046 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.322959 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.323799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.324384 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.595094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:46.603393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cccea799-1fd8-479a-8257-f75dfc7f8d86 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.298943 Aug 09 17:58:46.610037 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 178/374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:46 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:47.317390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:47.322612 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:47.360092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:47.361402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:47.362254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:47.364422 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:47.365095 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:47.366115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:47.467249 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-868489605", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76402604-ea92-4e64-a6a5-6720e8bdea8a"}], "security_groups": [{"name": "tempest-securitygroup--1996556039"}], "key_name": "tempest-keypair-330771617", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:47.624996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:47.638128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:47.645363 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:47.647656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-92b54a24-952b-4f7c-a3e0-72739a1ed0e2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.335601 Aug 09 17:58:47.649773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 197/375] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:47 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:47.659397 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:47.660121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:47.670754 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] validate_networks() for [('76402604-ea92-4e64-a6a5-6720e8bdea8a', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:58:47.674519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:47.683405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:47.684762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:47.688507 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:47.689196 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:47.690824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:47.947038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:47.965596 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b5cf1a26-3bba-4c77-8314-70fff7cfe2cf tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.313859 Aug 09 17:58:47.966887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 198/376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:47 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:48.329024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:48.329424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:48.330075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:48.330493 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:48.331145 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:48.356509 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:48.357006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:48.357695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:48.358934 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:48.359714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:48.360340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:48.381109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for project 13cf0de2979c44a08f500430834617d2. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:48.386632 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Getting quotas for user f7491479bd88425f8234e0b1d0e11e55 and project 13cf0de2979c44a08f500430834617d2. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:48.408878 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:58:48.411779 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:58:48.493233 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-009d8484-81a4-4b8d-9745-c154a0760a33 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.030763 Aug 09 17:58:48.520942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-23ecde84-190f-4b50-bb72-a6d0e2053977 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:48.520942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-23ecde84-190f-4b50-bb72-a6d0e2053977 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:48.521720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 179/377] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:58:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:58:48.621722 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-23ecde84-190f-4b50-bb72-a6d0e2053977 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:48.629064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-23ecde84-190f-4b50-bb72-a6d0e2053977 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1244 microversion: 2.1 time: 0.120996 Aug 09 17:58:48.643308 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 199/378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:48 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:48.671453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:48.672290 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:48.687587 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:48.690341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:48.691029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:48.692211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:48.692859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:48.693701 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:48.893253 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:48.905143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:48.906765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:48.907999 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d105bd4c-2658-4e46-b982-7bc759bdfdb1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.241888 Aug 09 17:58:48.923295 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 180/379] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:48 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:48.987751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:48.988790 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.003726 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.004394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.004933 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.005793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.006253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.006732 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.261395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:49.274149 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2d3fda93-e7c7-41da-91f1-6120e598a74e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.290911 Aug 09 17:58:49.279027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 200/380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:48 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:49.654233 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:49.654845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.663495 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.663934 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.667115 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.668031 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.671268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.672115 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.837394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:49.859871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-33ce53c5-2fae-460f-a210-165c8bd43921 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1240 microversion: 2.1 time: 0.211159 Aug 09 17:58:49.861530 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 181/381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:49 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1240 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:49.937737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:49.940469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.949755 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.950910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.951684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.952784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.953474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.954307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.151538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:50.164398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:50.166401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:50.167881 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ca95220c-4ddf-40c7-9d9b-3db686c2e464 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.237243 Aug 09 17:58:50.188931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 201/382] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:49 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:50.296095 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:50.296709 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:50.303777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.304264 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.304706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.307947 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.308463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.308903 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.634156 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:50.647645 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-11f89eef-1137-476f-9e95-748bee337716 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.355526 Aug 09 17:58:50.649076 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 182/383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:50 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:50.886706 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:50.888377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:50.901632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.901632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.901867 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.902557 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.903080 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.906114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.909279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-36bc86ee-c564-4389-be1d-3aea704f7dc5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: .version_select at 0x7f8c06d3b3a0>, body: {"keypair": {"name": "tempest-keypair-1165843173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXcZmf2S6jhctW2bajeWibH6X4MLGaR9CLurICIVLYjkDJRN+dJqIKkh7W3isArMQV+rO1Ce3Nz4EZDyy+NE3uaLOeiGth+v7HyG2R7LimPmIgIPATRFtJExTuO5zxvVg=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:50.936534 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-36bc86ee-c564-4389-be1d-3aea704f7dc5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:50.948345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-36bc86ee-c564-4389-be1d-3aea704f7dc5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:51.008238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-36bc86ee-c564-4389-be1d-3aea704f7dc5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102589 Aug 09 17:58:51.009256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 183/384] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 17:58:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:51.040206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:51.091585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec2c2744-b4df-4bd2-90ff-69e7a529509f tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1302 microversion: 2.1 time: 0.208780 Aug 09 17:58:51.097843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 202/385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:50 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1302 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:51.200758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:51.201626 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:51.211839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.213026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.214064 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:51.214904 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.215521 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.216226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:51.507930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:51.528515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:51.533304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:51.539127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c8bdbdd-82b5-4df4-a2af-760d49e716ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.342556 Aug 09 17:58:51.540760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 184/386] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:51 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:51.686360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:51.687365 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:51.701249 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.703572 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.704303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:51.705694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.706694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.707354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:52.112626 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:52.123653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:52.124498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:52.136395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1457ef21-e71f-439c-a445-4e2aad3498ca tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.470051 Aug 09 17:58:52.136990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 203/387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:51 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:52.161340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:52.162208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:52.162877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:52.164039 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:52.164683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:52.165430 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:52.567031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:52.568026 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:52.582185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:52.583015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:52.584619 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:52.585768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:52.587980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:52.589549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:52.606487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:52.624294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dff6d2d5-ffa9-4538-a2ac-181fa0578b75 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1370 microversion: 2.1 time: 0.508102 Aug 09 17:58:52.630123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 185/388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:52 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:53.010636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:53.023260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:53.026180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:53.029079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bda573c3-a207-4388-914f-2c9187efb8f7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.466052 Aug 09 17:58:53.045135 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 204/389] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:52 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:58:53.169368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:53.171125 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:53.186827 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.188227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.188924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.192140 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.193137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.194430 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.618012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:53.630499 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a86c56a-abb3-45f5-a553-6a04e466f0b9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.466271 Aug 09 17:58:53.643666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 186/390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:53 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:53.665338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:53.665880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:53.673652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.674144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.674599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.676555 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.677233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.677845 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.812721 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-765687461", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f6bff3-89eb-4947-b35c-63d3a99a9190"}], "security_groups": [{"name": "tempest-securitygroup--955411243"}], "key_name": "tempest-keypair-1165843173", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:54.011717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:54.025620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-63e22a8e-a93a-4bae-b51d-65cd017af748 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1370 microversion: 2.1 time: 0.364708 Aug 09 17:58:54.026215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 205/391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:53 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:54.041741 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] validate_networks() for [('88f6bff3-89eb-4947-b35c-63d3a99a9190', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:58:54.054171 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:54.055053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:54.062771 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:54.063493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:54.064075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:54.065523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:54.066502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:54.067244 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:54.575486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:54.595994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:54.599729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:54.602736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc6dee97-ff31-4620-a260-f876f994c86b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.552701 Aug 09 17:58:54.620818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 206/392] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:54 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:58:54.620818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-974a0311-8f60-4bcc-ada8-fe876736ad4b req-68097505-7dc2-41f0-b0e8-b3c21dbf4abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b85a38-edb0-4b79-aacd-a37285510d9d", "tag": "6a6de140-539e-4abe-b62f-b0a3cb0ddffc"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:54.644073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-974a0311-8f60-4bcc-ada8-fe876736ad4b req-68097505-7dc2-41f0-b0e8-b3c21dbf4abc service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:54.645286 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-974a0311-8f60-4bcc-ada8-fe876736ad4b req-68097505-7dc2-41f0-b0e8-b3c21dbf4abc service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:54.649222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-974a0311-8f60-4bcc-ada8-fe876736ad4b req-68097505-7dc2-41f0-b0e8-b3c21dbf4abc service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:54.681062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-974a0311-8f60-4bcc-ada8-fe876736ad4b req-68097505-7dc2-41f0-b0e8-b3c21dbf4abc service nova] Creating event network-changed:6a6de140-539e-4abe-b62f-b0a3cb0ddffc for instance 96b85a38-edb0-4b79-aacd-a37285510d9d on hv-cinder-83608 Aug 09 17:58:54.705409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-974a0311-8f60-4bcc-ada8-fe876736ad4b req-68097505-7dc2-41f0-b0e8-b3c21dbf4abc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096235 Aug 09 17:58:54.710930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 207/393] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:54.725793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:54.726618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:54.738335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:54.739323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:54.740380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:54.741476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:54.742579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:54.743585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.173759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:55.187872 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aebdde6e-e8f5-46bb-b3a0-afd48399ffeb tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.474274 Aug 09 17:58:55.204872 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 208/394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:54 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:55.211766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:55.212557 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:55.220816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.221857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.228570 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.229813 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.230518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.231211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.270823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:55.271900 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:55.272900 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:55.274158 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:55.274678 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:55.288402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.288992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.289502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.290307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.290989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.291514 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.314400 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:55.319932 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:55.337024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:58:55.339447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:58:55.397151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-039e3c28-b98c-4b59-8e0b-d2bd73afa075 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.589347 Aug 09 17:58:55.399357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 187/395] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 17:58:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:58:55.410176 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9327bd87-d4e2-4454-88c1-35f6ef5df00d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:55.411159 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9327bd87-d4e2-4454-88c1-35f6ef5df00d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:55.515539 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9327bd87-d4e2-4454-88c1-35f6ef5df00d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:55.519305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:55.528358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-81c2bce1-921d-4234-8a5d-5af6ec4cc138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1370 microversion: 2.1 time: 0.321724 Aug 09 17:58:55.536175 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 209/396] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:55 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:55.546041 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9327bd87-d4e2-4454-88c1-35f6ef5df00d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1241 microversion: 2.1 time: 0.139946 Aug 09 17:58:55.547191 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 188/397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:55 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:55.635665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:55.643554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:55.650518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.651131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.651637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.652552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.653328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.653824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.869127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:55.891134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:55.892606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:55.893930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0187ea36-f1d4-4abd-ba9f-ee14c90b2566 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.264215 Aug 09 17:58:55.894673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 210/398] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:55 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:56.211435 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:56.212474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:56.225256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.226667 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.229329 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.230152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.247018 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.248253 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.556249 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:56.557783 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:56.566581 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.567353 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.567989 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.568868 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.569507 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.570534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.622825 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:56.635890 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b90e68ce-7a14-40cc-ae6d-ef1a3d1e6342 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.428222 Aug 09 17:58:56.651019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 189/399] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:56 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:56.651019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:56.651019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:56.663887 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.664669 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.665132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.666676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.667367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.668047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.688741 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:56.758583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:56.773376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-37d2c282-586a-4156-acda-0e0a7f838178 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1293 microversion: 2.1 time: 0.127493 Aug 09 17:58:56.773986 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 190/400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:56 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1293 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:56.801137 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:56.813062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6ef0537f-81fd-4be1-a143-6200030961ca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1370 microversion: 2.1 time: 0.266526 Aug 09 17:58:56.815496 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 211/401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:56 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:56.917694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:56.918343 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:56.925466 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.926172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.926797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.927525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.928128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.928710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.294309 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:57.305142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:57.307059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:57.308586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1c20056b-7bd3-482c-81f8-06d1aafc3a31 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.394786 Aug 09 17:58:57.309246 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 191/402] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:56 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:57.660117 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:57.662736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:57.679314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:57.680166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:57.681216 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.682610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:57.683594 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:57.684760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.796531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:57.797045 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:57.823745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:57.824252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:57.826888 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.827680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:57.828151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:57.828583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.887212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:57.899696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f87a358a-e831-428f-83c3-b1255c90dd3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.244995 Aug 09 17:58:57.916254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 212/403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:57 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:57.924697 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:57.925649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:57.932982 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:57.936952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:57.937737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.938860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:57.939716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:57.940360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.958367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:57.969412 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-33a7d86f-c27d-4d1d-b445-d1d10a42d307 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1299 microversion: 2.1 time: 0.178085 Aug 09 17:58:57.976901 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 192/404] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:57 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:58.227664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:58.235187 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:58.242327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aedc0fe8-ba39-4bb9-9694-1c32c3e80c4e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1370 microversion: 2.1 time: 0.324466 Aug 09 17:58:58.256151 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 213/405] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:57 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:58.344178 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:58.344729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:58.345263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-9a1b7b0c-6833-40c6-beb6-1ed8b8f821d3 req-b8226cce-11de-4777-8155-245dedee10a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b85a38-edb0-4b79-aacd-a37285510d9d", "name": "network-vif-plugged", "status": "completed", "tag": "6a6de140-539e-4abe-b62f-b0a3cb0ddffc"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:58.357772 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9a1b7b0c-6833-40c6-beb6-1ed8b8f821d3 req-b8226cce-11de-4777-8155-245dedee10a6 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.358546 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9a1b7b0c-6833-40c6-beb6-1ed8b8f821d3 req-b8226cce-11de-4777-8155-245dedee10a6 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.359191 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9a1b7b0c-6833-40c6-beb6-1ed8b8f821d3 req-b8226cce-11de-4777-8155-245dedee10a6 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.375654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.376327 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.376979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.379889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.380062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-9a1b7b0c-6833-40c6-beb6-1ed8b8f821d3 req-b8226cce-11de-4777-8155-245dedee10a6 service nova] Creating event network-vif-plugged:6a6de140-539e-4abe-b62f-b0a3cb0ddffc for instance 96b85a38-edb0-4b79-aacd-a37285510d9d on hv-cinder-83608 Aug 09 17:58:58.380835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.381303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.386008 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-9a1b7b0c-6833-40c6-beb6-1ed8b8f821d3 req-b8226cce-11de-4777-8155-245dedee10a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045143 Aug 09 17:58:58.386842 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 214/406] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:58.691391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:58.720861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:58.725593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:58.727437 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-af77ead2-7c9c-416d-b42c-44e6d20f17a4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.395242 Aug 09 17:58:58.728400 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 193/407] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:58 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:58:58.924758 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:58.926758 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:58.933659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:58.936338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.937656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.938289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.939056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.939563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.940838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.999666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:59.000480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:59.011616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.013843 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.014542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.015633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.016549 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.017196 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.137059 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.149050 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-38affc3f-1bfb-4bf9-bdbd-a70d7c0402b1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.229145 Aug 09 17:58:59.163226 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 215/408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:58 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:59.265530 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:59.266143 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:59.276979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.280911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.281427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.281874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.283015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.283638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.284226 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.287903 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b885360-142f-44eb-b7ce-351949624250 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.293151 Aug 09 17:58:59.289265 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 194/409] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:58 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:59.452216 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c897cefc-b409-444e-bf33-61eedd42405d req-6f5113e9-76c4-4139-897f-e632625bfcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6b079a-3718-45b9-9707-a39242dc9aa5", "tag": "031be3e9-579f-42bf-85e1-5c7d4af44e31"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:59.457926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:59.468143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c897cefc-b409-444e-bf33-61eedd42405d req-6f5113e9-76c4-4139-897f-e632625bfcb2 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.468872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c897cefc-b409-444e-bf33-61eedd42405d req-6f5113e9-76c4-4139-897f-e632625bfcb2 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.469837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c897cefc-b409-444e-bf33-61eedd42405d req-6f5113e9-76c4-4139-897f-e632625bfcb2 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.500509 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c897cefc-b409-444e-bf33-61eedd42405d req-6f5113e9-76c4-4139-897f-e632625bfcb2 service nova] Creating event network-changed:031be3e9-579f-42bf-85e1-5c7d4af44e31 for instance ed6b079a-3718-45b9-9707-a39242dc9aa5 on hv-cinder-83608 Aug 09 17:58:59.509841 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.516279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c897cefc-b409-444e-bf33-61eedd42405d req-6f5113e9-76c4-4139-897f-e632625bfcb2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068055 Aug 09 17:58:59.517446 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 195/410] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:59.519812 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-53d10489-772a-4bc7-a480-23397937fed4 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1370 microversion: 2.1 time: 0.258610 Aug 09 17:58:59.521300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 216/411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:59 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:59.757179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:59.757921 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:59.767219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.767944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.768534 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.769540 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.770383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.771154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.941022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.950710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.953244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.954416 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8fa0aeb1-d4ce-4d72-8f88-d354e2e6a8a6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.203197 Aug 09 17:58:59.955218 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 196/412] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:58:59 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:00.171696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:00.172900 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:00.180664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.181152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.181581 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.182273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.182712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.183161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.313538 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:00.315474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:00.325650 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.326605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.327160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.328078 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.328946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.329542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.382103 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:00.391176 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82ec8655-6c52-492e-9fe0-e7db9d6df65f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.225214 Aug 09 17:59:00.392326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 217/413] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:00 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:00.546129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:00.548195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:00.568857 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:00.573428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.579879 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.580181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e3a040db-1b6d-4903-baf5-ceaf3b2b1465 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.272556 Aug 09 17:59:00.580981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.582307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 197/414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:00 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:00.598875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.603490 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.603969 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.758447 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:00.770595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4646677b-80b1-440d-9fa5-f4971906b7cd tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1370 microversion: 2.1 time: 0.232281 Aug 09 17:59:00.783000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 218/415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:00 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:00.987096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:00.988024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:01.011675 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.012720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.013261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.014072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.014590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.015151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.229713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:01.241722 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:01.251057 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:01.254248 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ad81b52e-56fe-44e9-a051-d58cdb90bc71 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.278835 Aug 09 17:59:01.259095 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 198/416] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:00 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:59:01.414161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:01.415501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:01.422212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.423222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.424010 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.424939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.425606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.426334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.598772 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:01.610741 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:01.612370 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:01.614452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bccff7a3-02f5-47fe-b3fb-1988fe724d3b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.204473 Aug 09 17:59:01.617024 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 219/417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:01 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:01.623443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.625136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.626272 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.628729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.629885 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.630703 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.795241 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:01.795761 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:01.807250 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.807739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.808300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.808978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.809552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.809981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.849124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:01.878112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c2835c31-aef2-47a5-a28b-5f01edf1b26b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.272825 Aug 09 17:59:01.881612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 199/418] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:01 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:02.035941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:02.047412 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d5a01c01-6801-47d7-aa13-9a95bfe4d83b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1564 microversion: 2.1 time: 0.256786 Aug 09 17:59:02.051044 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 220/419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:01 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1564 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:02.068794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:02.075107 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:02.082135 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.082671 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.083162 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.083842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.084435 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.084745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.206957 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-69cf1262-d730-4813-b1ab-f2a47f18bae5 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142331 Aug 09 17:59:02.207981 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 200/420] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 17:59:02 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:59:02.302071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:02.303707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:02.317964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.318559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.319759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.321118 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.321864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.322660 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.641321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:02.650090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:02.653526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:02.654219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:02.654367 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:02.656039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-46fc5987-1e35-434f-81f7-94b7b45e9ee7 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.367390 Aug 09 17:59:02.671768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 221/421] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:02 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:02.675363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.675897 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.676484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.677403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.677841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.678267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.908526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:02.909584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:02.916747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.917548 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.918147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.919097 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.919883 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.920512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:03.277281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:03.306090 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67041d67-f2e4-43b6-aea8-d40161e9417c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1724 microversion: 2.1 time: 0.660565 Aug 09 17:59:03.307042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 201/422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:02 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1724 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:03.435839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:03.446035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9aa7a473-892f-4671-bdbf-459543c811d8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.541867 Aug 09 17:59:03.450002 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 222/423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:02 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:03.681590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:03.683047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:03.690821 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:03.691680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:03.692346 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:03.693272 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:03.694086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:03.694717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:03.899557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:03.908770 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:03.910283 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:03.911484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-599f2c34-cd25-485f-8db5-9d409b81e0bd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.234103 Aug 09 17:59:03.912083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 202/424] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:03 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:04.048218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d9d520f1-3716-4549-a852-abc4a0d75543 req-8e7805c4-39c4-4465-8f0c-dcb8a6904095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b85a38-edb0-4b79-aacd-a37285510d9d", "tag": "6a6de140-539e-4abe-b62f-b0a3cb0ddffc"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:04.057963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d9d520f1-3716-4549-a852-abc4a0d75543 req-8e7805c4-39c4-4465-8f0c-dcb8a6904095 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.058440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d9d520f1-3716-4549-a852-abc4a0d75543 req-8e7805c4-39c4-4465-8f0c-dcb8a6904095 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.058941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d9d520f1-3716-4549-a852-abc4a0d75543 req-8e7805c4-39c4-4465-8f0c-dcb8a6904095 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.071233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d9d520f1-3716-4549-a852-abc4a0d75543 req-8e7805c4-39c4-4465-8f0c-dcb8a6904095 service nova] Creating event network-changed:6a6de140-539e-4abe-b62f-b0a3cb0ddffc for instance 96b85a38-edb0-4b79-aacd-a37285510d9d on hv-cinder-83608 Aug 09 17:59:04.077003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d9d520f1-3716-4549-a852-abc4a0d75543 req-8e7805c4-39c4-4465-8f0c-dcb8a6904095 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032520 Aug 09 17:59:04.077607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 223/425] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:59:04.332035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:04.340063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:04.348227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.348724 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.349166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.349883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.350363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.354157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.473844 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:04.475082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:04.490298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.491068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.491754 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.492887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.493742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.494708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.544067 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:04.552813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8edb2198-6455-406d-b47b-a48f72136eed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1701 microversion: 2.1 time: 0.224791 Aug 09 17:59:04.568639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 203/426] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:04 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1701 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:04.577342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d647632d-6aa3-4d7b-a17f-15e810b1b70e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:04.586840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d647632d-6aa3-4d7b-a17f-15e810b1b70e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.587541 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d647632d-6aa3-4d7b-a17f-15e810b1b70e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.588566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d647632d-6aa3-4d7b-a17f-15e810b1b70e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.639962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d647632d-6aa3-4d7b-a17f-15e810b1b70e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Going to try to start instance {{(pid=117885) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 17:59:04.738939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:04.758452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-70c352aa-892e-4c91-9092-83b0707b1828 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.287802 Aug 09 17:59:04.761412 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 224/427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:04 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:04.769505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d647632d-6aa3-4d7b-a17f-15e810b1b70e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action" status: 202 len: 0 microversion: 2.1 time: 0.193451 Aug 09 17:59:04.771909 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 204/428] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 17:59:04 2022] POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:59:04.786592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:04.791013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:04.815919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.819874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.821575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.823837 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.826431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.827425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.935156 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:04.936545 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:04.952631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.954007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.955735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.958240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.960950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.962689 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:05.158848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:05.180481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-db3c5fcc-58e5-4697-bc40-b4dd9725442a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1710 microversion: 2.1 time: 0.403369 Aug 09 17:59:05.190828 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 225/429] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:04 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1710 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:05.300648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:05.314411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:05.330795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:05.336462 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:05.338421 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-18a2f59e-782f-40e7-839f-5e730191ed97 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1745 microversion: 2.20 time: 0.408493 Aug 09 17:59:05.351307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 205/430] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:04 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1745 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:05.784654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:05.785582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:05.792120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:05.792611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:05.794185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:05.795128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:05.795756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:05.796348 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.016818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:06.025021 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-943402f3-1798-42b8-b8f6-75d05058e095 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.244517 Aug 09 17:59:06.039094 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 226/431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:05 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:06.202757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:06.203764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:06.205330 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=22 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:06.211131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.211623 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.212050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.212758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.213207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.213628 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.364670 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:06.366721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:06.377742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.378579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.380022 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.381020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.382525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.383346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.432766 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:06.445967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d333ad5-76d0-4235-a48a-b3f700e3434d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1710 microversion: 2.1 time: 0.247421 Aug 09 17:59:06.447553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 206/432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:06 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1710 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:06.588018 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:06.597334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:06.599201 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:06.600610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-568b58ba-c5b2-44f1-adca-f2b4c63aa9c0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.241737 Aug 09 17:59:06.601678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 227/433] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:06 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:07.047472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:07.048169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:07.063467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.064279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.072803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.073733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.074282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.074953 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.079973 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:07.357790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:07.405339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-58c65268-e179-48b0-8060-801f5a7026ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.362716 Aug 09 17:59:07.406052 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 207/434] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:07 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:07.470405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:07.472221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:07.480049 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.481370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.482120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.483166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.483808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.484525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.630330 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:07.631625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:07.682238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.685504 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.687949 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.689920 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.692386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.692386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.697417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:07.729886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7038f2f2-0f2c-4804-bf7d-35fd676fec02 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1714 microversion: 2.1 time: 0.264794 Aug 09 17:59:07.731344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 228/435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:07 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1714 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:07.920659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:07.937573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:07.940779 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:07.942929 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c9d8ec81-71fc-4136-96ca-e83b016a9d40 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.320068 Aug 09 17:59:07.951578 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 208/436] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:07 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:08.427524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:08.428144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:08.430856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=84 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:08.444986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:08.446929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:08.448039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:08.454592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:08.455173 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:08.455655 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:08.638786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c916010a-1327-42b4-9b15-27d530617da9 req-045de2d0-d7eb-4390-a4ab-22064d8d8b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6b079a-3718-45b9-9707-a39242dc9aa5", "name": "network-vif-plugged", "status": "completed", "tag": "031be3e9-579f-42bf-85e1-5c7d4af44e31"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:08.663798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c916010a-1327-42b4-9b15-27d530617da9 req-045de2d0-d7eb-4390-a4ab-22064d8d8b5b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:08.666898 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c916010a-1327-42b4-9b15-27d530617da9 req-045de2d0-d7eb-4390-a4ab-22064d8d8b5b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:08.669817 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c916010a-1327-42b4-9b15-27d530617da9 req-045de2d0-d7eb-4390-a4ab-22064d8d8b5b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:08.681798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:08.689980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7b818075-d912-481a-a357-1f6d5737cead tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.267791 Aug 09 17:59:08.694813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c916010a-1327-42b4-9b15-27d530617da9 req-045de2d0-d7eb-4390-a4ab-22064d8d8b5b service nova] Creating event network-vif-plugged:031be3e9-579f-42bf-85e1-5c7d4af44e31 for instance ed6b079a-3718-45b9-9707-a39242dc9aa5 on hv-cinder-83608 Aug 09 17:59:08.704188 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c916010a-1327-42b4-9b15-27d530617da9 req-045de2d0-d7eb-4390-a4ab-22064d8d8b5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069388 Aug 09 17:59:08.704702 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 229/437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:08 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:08.706478 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 209/438] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:59:08.975037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:08.976244 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:08.988137 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:08.990101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:08.990925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:08.994553 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:08.995082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:08.997288 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:09.186749 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:09.199028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:09.202517 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:09.204140 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0802b7f2-8046-42bb-9d8e-a1491a5b76bb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.234446 Aug 09 17:59:09.219015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 230/439] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:08 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:09.717607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:09.718964 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:09.733221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:09.734005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:09.734645 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:09.735382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:09.735996 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:09.736631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:09.933370 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:09.957106 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c8d08f2-b86a-4136-bd48-afa6176b7d5d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1366 microversion: 2.1 time: 0.247762 Aug 09 17:59:09.974161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 210/440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:09 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:10.238288 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:10.239679 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:10.249923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.251121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.251946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.253259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.253986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.254610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.425663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:10.429787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:10.438333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:10.441524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:10.444169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8538a382-e4d2-4e25-85c7-ba96b5334302 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.209510 Aug 09 17:59:10.445359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 231/441] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:10 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:10.734389 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-8f3d83d2-ee09-4fa4-9215-d66789126da7 req-f3667b6c-c2c0-4868-9daf-46afbe108baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe8c172-bab3-4a24-b716-1b536176ef81", "name": "network-vif-plugged", "status": "completed", "tag": "9fa650be-eba1-4201-8c24-eb7b2ec8a90a"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:10.747703 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8f3d83d2-ee09-4fa4-9215-d66789126da7 req-f3667b6c-c2c0-4868-9daf-46afbe108baa service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.748889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8f3d83d2-ee09-4fa4-9215-d66789126da7 req-f3667b6c-c2c0-4868-9daf-46afbe108baa service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.750811 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8f3d83d2-ee09-4fa4-9215-d66789126da7 req-f3667b6c-c2c0-4868-9daf-46afbe108baa service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.766501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-8f3d83d2-ee09-4fa4-9215-d66789126da7 req-f3667b6c-c2c0-4868-9daf-46afbe108baa service nova] Creating event network-vif-plugged:9fa650be-eba1-4201-8c24-eb7b2ec8a90a for instance ffe8c172-bab3-4a24-b716-1b536176ef81 on hv-cinder-83608 Aug 09 17:59:10.772169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-8f3d83d2-ee09-4fa4-9215-d66789126da7 req-f3667b6c-c2c0-4868-9daf-46afbe108baa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041588 Aug 09 17:59:10.772985 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 211/442] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:10.981506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:10.981996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:10.988405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.988961 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.989631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.990038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.990438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.990865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.180302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:11.191248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8aade9a1-a8c9-4eca-b628-6a5156917ff4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1555 microversion: 2.1 time: 0.214068 Aug 09 17:59:11.192444 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 232/443] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:10 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:11.222307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:11.223434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:11.238508 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.239293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.239891 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.241287 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.242027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.242828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.359173 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b3afe279-d728-4a91-967e-f5356bf2e356 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145559 Aug 09 17:59:11.367131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 212/444] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 17:59:11 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:59:11.490744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:11.491300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:11.503219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.504221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.504832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.505820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.506536 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.507152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.722952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:11.750402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:11.754565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:11.755972 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-45993b07-9a19-4563-be96-0ced378186f8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.271675 Aug 09 17:59:11.777186 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 233/445] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:11 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:12.782572 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:12.783347 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:12.797845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:12.798353 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:12.798758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:12.799501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:12.799956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:12.802885 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:12.842988 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-e05199fc-2f98-46af-bad9-44b618a41f6b req-9a3a55d3-9861-47df-9126-0a5ef201f8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6b079a-3718-45b9-9707-a39242dc9aa5", "tag": "031be3e9-579f-42bf-85e1-5c7d4af44e31"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:12.875832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e05199fc-2f98-46af-bad9-44b618a41f6b req-9a3a55d3-9861-47df-9126-0a5ef201f8de service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:12.876331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e05199fc-2f98-46af-bad9-44b618a41f6b req-9a3a55d3-9861-47df-9126-0a5ef201f8de service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:12.876768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e05199fc-2f98-46af-bad9-44b618a41f6b req-9a3a55d3-9861-47df-9126-0a5ef201f8de service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:12.930864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-e05199fc-2f98-46af-bad9-44b618a41f6b req-9a3a55d3-9861-47df-9126-0a5ef201f8de service nova] Creating event network-changed:031be3e9-579f-42bf-85e1-5c7d4af44e31 for instance ed6b079a-3718-45b9-9707-a39242dc9aa5 on hv-cinder-83608 Aug 09 17:59:12.951936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-e05199fc-2f98-46af-bad9-44b618a41f6b req-9a3a55d3-9861-47df-9126-0a5ef201f8de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109201 Aug 09 17:59:12.966080 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 234/446] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:13.071014 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:13.080056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:13.081680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:13.092210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d47b19eb-debf-40c9-8a61-2fbaf2db7bb8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.304609 Aug 09 17:59:13.092899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 213/447] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:12 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:14.122118 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:14.123528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:14.159791 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.160997 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.161691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:14.162609 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.163165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.163704 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:14.396780 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:14.411162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:14.423980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:14.425616 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3566459b-e900-4f25-8919-e06fb2fb8ff5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.311308 Aug 09 17:59:14.430533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 235/448] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:14 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:15.459662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:15.460467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:15.471576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:15.472074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:15.472517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:15.473228 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:15.473683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:15.474110 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:15.642147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:15.650340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:15.651901 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:15.653335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-06ebf5a6-50b2-4471-8edc-d2392ee226ae tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.197782 Aug 09 17:59:15.654094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 214/449] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:15 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:16.677000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:16.677729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:16.687232 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.687740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.688216 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.688947 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.689377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.689898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.842714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:16.851656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:16.855020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:16.857318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9e1ceea-6d8a-4572-ada0-a16381518470 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.184162 Aug 09 17:59:16.858588 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 236/450] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:16 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:17.882552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:17.883208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:17.891136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:17.891607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:17.892042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:17.892776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:17.893227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:17.893644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:18.067576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:18.080509 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:18.082050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:18.083313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3d4520e7-5fb7-403a-ac07-a7c02b17cd06 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.205050 Aug 09 17:59:18.083890 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 215/451] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:17 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:19.107458 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:19.108068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:19.114131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:19.114607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:19.115061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:19.115757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:19.116206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:19.116630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:19.247678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:19.255893 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:19.257406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:19.258550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8dd2559f-f600-4b5f-809a-b6e512d111e6 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1740 microversion: 2.20 time: 0.155743 Aug 09 17:59:19.259136 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 237/452] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:19 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:59:20.284906 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:20.285480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:20.291989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:20.292476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:20.293431 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:20.294125 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:20.294575 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:20.295023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:20.437470 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:20.445380 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:20.446895 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:20.448072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-01a4c66a-a61d-4467-9978-b8ca26f78557 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1722 microversion: 2.20 time: 0.167200 Aug 09 17:59:20.448759 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 216/453] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:20 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:21.471799 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:21.472410 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:21.478338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:21.478810 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:21.479283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:21.480105 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:21.481476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:21.481476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:21.626400 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:21.634361 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:21.635955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:21.637096 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3778edb5-fe24-4cd7-b844-4816aa90dc68 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1722 microversion: 2.20 time: 0.169205 Aug 09 17:59:21.637659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 238/454] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:21 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:22.587876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-f1a43f91-26fc-41b7-abf8-cf8ebdf5042d req-0c41dc53-4e31-40db-b4a8-dd63f79a1b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe8c172-bab3-4a24-b716-1b536176ef81", "name": "network-vif-unplugged", "status": "completed", "tag": "9fa650be-eba1-4201-8c24-eb7b2ec8a90a"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:22.598807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f1a43f91-26fc-41b7-abf8-cf8ebdf5042d req-0c41dc53-4e31-40db-b4a8-dd63f79a1b31 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:22.599325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f1a43f91-26fc-41b7-abf8-cf8ebdf5042d req-0c41dc53-4e31-40db-b4a8-dd63f79a1b31 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:22.599766 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f1a43f91-26fc-41b7-abf8-cf8ebdf5042d req-0c41dc53-4e31-40db-b4a8-dd63f79a1b31 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:22.611744 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.compute.server_external_events [req-f1a43f91-26fc-41b7-abf8-cf8ebdf5042d req-0c41dc53-4e31-40db-b4a8-dd63f79a1b31 service nova] Unable to find a host for instance ffe8c172-bab3-4a24-b716-1b536176ef81. Dropping event network-vif-unplugged {{(pid=117885) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 17:59:22.612660 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-f1a43f91-26fc-41b7-abf8-cf8ebdf5042d req-0c41dc53-4e31-40db-b4a8-dd63f79a1b31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028731 Aug 09 17:59:22.613255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 217/455] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 17:59:22.660285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:22.660911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:22.666788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:22.667457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:22.667762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:22.669114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:22.669578 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:22.669991 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:22.802925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:22.810815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:22.812337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:22.813488 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-edee3a4f-47a8-4a0c-ad42-e9c92b6e95e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1665 microversion: 2.20 time: 0.157303 Aug 09 17:59:22.814065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 239/456] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:22 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:22.835974 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40db782f-e05e-4b79-8555-441c5da169c2"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:22.838199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:22.844874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:22.845379 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:22.845812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:22.846495 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:22.846946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:22.847394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:23.129808 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-693b6372-31bf-40eb-bf98-91552353e230 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297989 Aug 09 17:59:23.130442 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 218/457] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Aug 9 17:59:22 2022] POST /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:59:23.257073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:23.257704 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:23.264293 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:23.264772 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:23.265207 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:23.265898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:23.266345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:23.266784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:23.308934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117886) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 17:59:23.377335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-576b9828-f5e2-4aa1-b2da-beaf837033f9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/action" status: 202 len: 0 microversion: 2.20 time: 0.124162 Aug 09 17:59:23.377939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 240/458] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 9 17:59:23 2022] POST /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:59:23.386234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:23.386878 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:23.394354 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:23.394838 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:23.395407 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:23.396074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:23.396527 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:23.396956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:23.535743 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:23.544495 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:23.546038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:23.547245 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ecc9542-907c-4f3c-bf9c-d8ece6d0acc2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1751 microversion: 2.20 time: 0.164918 Aug 09 17:59:23.547839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 219/459] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:23 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:24.573653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:24.574620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:24.581018 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:24.581511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:24.581942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:24.582716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:24.583246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:24.583671 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:24.730028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:24.738464 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:24.739980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:24.741121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-28879f8e-815c-4533-8486-d290a7328099 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1753 microversion: 2.20 time: 0.171556 Aug 09 17:59:24.741676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 241/460] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:24 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:25.766084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:25.766699 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:25.773190 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:25.773677 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:25.774115 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:25.774815 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:25.775300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:25.775726 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:25.906353 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:25.914780 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:25.916336 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:25.917996 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4ff242d2-17ef-4288-b98d-25dd2a663aa4 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.155455 Aug 09 17:59:25.918125 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 220/461] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:25 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:26.940804 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:26.941414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:26.947409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:26.947886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:26.948313 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:26.948994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:26.949538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:26.950122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:27.089753 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:27.100438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:27.102381 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:27.103781 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-66bea9c5-a9d2-423b-a514-64e761a88170 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.166819 Aug 09 17:59:27.119688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 242/462] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:26 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:28.129508 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:28.130298 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:28.137203 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:28.137695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:28.138131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:28.138899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:28.139386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:28.139811 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:28.277896 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:28.286501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:28.288037 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:28.289177 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-12aa8e44-40e6-4a5b-90ae-e23311fc1ed0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.163687 Aug 09 17:59:28.289734 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 221/463] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:28 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:29.313355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:29.313889 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:29.320573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:29.321054 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:29.321487 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:29.322181 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:29.322631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:29.323074 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:29.460145 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:29.468946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:29.470471 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:29.471659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82985706-1782-4a41-b975-58c1ed34644e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.163115 Aug 09 17:59:29.472474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 243/464] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:29 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:30.494580 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:30.495855 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:30.498347 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=54 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:30.504505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:30.505005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:30.505448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:30.506147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:30.506602 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:30.507054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:30.643972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:30.652675 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:30.654192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:30.656354 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4f6e6955-47ea-44eb-aa77-a14855bd376e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.164771 Aug 09 17:59:30.657241 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 222/465] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:30 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:31.679852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:31.681185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:31.688051 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.688530 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.688954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.689643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.690090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.690501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.824656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:31.833819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:31.835346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:31.836481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-88766cb7-73f2-4e79-b613-ede5b74483e3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.160901 Aug 09 17:59:31.837034 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 244/466] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:31 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:32.860096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:32.860703 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:32.867182 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:32.867659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:32.868091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:32.868815 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:32.869266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:32.869685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:32.889587 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:33.019558 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:33.028360 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:33.029861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:33.031038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b7dbc531-94ee-42bb-8112-a02d59ab8d2c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.174842 Aug 09 17:59:33.031600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 223/467] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:32 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:34.054556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:34.055903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:34.063134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:34.063623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:34.064048 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:34.064740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:34.065180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:34.065595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:34.219537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:34.228205 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:34.229698 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:34.230841 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cfc9179c-128f-4409-91c8-f964bd1ade26 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.180261 Aug 09 17:59:34.231430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 245/468] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:34 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:35.255057 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:35.256103 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:35.263230 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:35.264071 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:35.264735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:35.265713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:35.267142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:35.267804 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:35.437044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:35.446175 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:35.447721 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:35.448873 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-73c41504-d601-4bf7-a531-4ad2e6c9bf9e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.197710 Aug 09 17:59:35.449436 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 224/469] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:35 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:36.473242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:36.473938 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:36.479715 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:36.480186 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:36.480609 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:36.481281 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:36.481721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:36.482133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:36.651139 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:36.667352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:36.670285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:36.672306 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f6ed2d99-9858-4377-9160-88fdc09b0dcf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.203231 Aug 09 17:59:36.673245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 246/470] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:36 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:37.696394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:37.697000 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:37.703689 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:37.704162 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:37.704595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:37.705275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:37.705746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:37.706160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:37.846107 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:37.854424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:37.856033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:37.857173 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dce2ad62-d60a-4e1f-bc17-aa40d732423f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.164701 Aug 09 17:59:37.857733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 225/471] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:37 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:38.885345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:38.885974 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:38.888442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:38.895661 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:38.896145 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:38.896574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:38.897270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:38.897721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:38.898280 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:39.054042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:39.071323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:39.073099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:39.074263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec017ae6-27f4-4966-a38e-a0d15f252ece tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.194752 Aug 09 17:59:39.074833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 247/472] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:38 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:40.101791 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:40.102440 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:40.109149 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:40.109633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:40.110084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:40.110780 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:40.111252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:40.111672 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:40.254783 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:40.263339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:40.264772 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:40.265910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8bf59c5f-e483-4f2c-a272-d5c2c2d40dac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.168005 Aug 09 17:59:40.266511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 226/473] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:40 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:41.289440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:41.290056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:41.296021 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:41.296493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:41.296928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:41.298104 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:41.298548 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:41.298965 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:41.301628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:41.442738 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:41.451274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:41.452767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:41.453919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8c278190-04f3-456c-af75-1fe1425944a3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.168384 Aug 09 17:59:41.454696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 248/474] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:41 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:42.476962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:42.477813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:42.484382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:42.484867 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:42.485313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:42.485997 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:42.486459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:42.486882 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:42.617320 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:42.626017 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:42.627547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:42.629206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-87dd1b3c-5836-4733-9d77-4a6a026fc61f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.155862 Aug 09 17:59:42.629828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 227/475] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:42 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:43.653077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:43.653701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:43.659756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:43.660229 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:43.660652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:43.661327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:43.661789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:43.662223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:43.795363 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:43.804527 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:43.806029 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:43.807219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5d5c3721-0ae5-44f6-8a2e-1804185526cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.157963 Aug 09 17:59:43.807779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 249/476] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:43 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:44.829707 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:44.830308 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:44.837079 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:44.837584 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:44.838020 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:44.838708 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:44.839193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:44.839614 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:44.970342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:44.978704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:44.980255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:44.981436 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b04769e-0e22-444f-9e4c-3845ae1e95c8 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.155619 Aug 09 17:59:44.982025 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 228/477] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:44 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:59:46.006248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:46.006858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:46.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:46.013288 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:46.013746 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:46.014419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:46.014863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:46.015305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:46.145337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:46.153515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:46.155012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:46.156141 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f0ea45c-e7bc-4329-8e50-3ff1829e72cb tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.154360 Aug 09 17:59:46.156691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 250/478] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:46 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:47.180234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:47.180852 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:47.187526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:47.188013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:47.188450 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:47.189155 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:47.189616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:47.190040 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:47.336492 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:47.345212 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:47.346685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:47.347938 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6316f77e-11f4-449d-9b04-00224d7f33ac tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.172129 Aug 09 17:59:47.348497 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 229/479] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:47 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:48.373332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:48.373938 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:48.380444 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:48.380918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:48.381347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:48.382028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:48.382476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:48.382892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:48.520571 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:48.528813 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:48.530299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:48.531463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2dfede6a-56db-42fe-a0ad-48674529625e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.162143 Aug 09 17:59:48.532025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 251/480] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:48 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:49.554830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:49.555496 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:49.561919 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:49.562403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:49.562836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:49.563552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:49.564005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:49.564423 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:49.692208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:49.700618 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:49.702126 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:49.703304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-96a4c7bb-3f5c-4733-8023-16e3b9ca767c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.152339 Aug 09 17:59:49.703868 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 230/481] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:49 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:50.728238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:50.728880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:50.734840 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:50.735347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:50.735776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:50.736461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:50.736908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:50.737327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:50.867100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:50.875717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:50.877202 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:50.878366 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-18cddc60-5e29-45f7-b844-03f5cf9725ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.155613 Aug 09 17:59:50.878918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 252/482] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:50 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:51.901593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:51.902240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:51.908684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:51.909169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:51.909607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:51.910292 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:51.910746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:51.911219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:52.040995 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:52.049373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:52.051493 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:52.052649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5fba5014-71ff-4866-89de-4cd310341dc9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.155025 Aug 09 17:59:52.053216 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 231/483] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:51 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:59:53.075933 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:53.076669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:53.083625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.084106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.084569 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.085252 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.085696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.086113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.216086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:53.224370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:53.225853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:53.227015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2fa83e03-86de-45f7-b9d1-96b22905de05 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.155213 Aug 09 17:59:53.227571 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 253/484] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:53 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:59:54.250026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:54.250636 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:54.257630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:54.258121 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:54.258561 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:54.259268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:54.259727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:54.260155 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:54.392803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:54.403120 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:54.404655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:54.405810 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5f88374c-7ee4-432a-8382-f55214615c25 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.159973 Aug 09 17:59:54.406367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 232/485] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:54 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:54.686926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a9b0c511-1399-48b9-9bd2-0343debe8d26 req-a6d81e17-84a1-4c52-a829-c24080c75fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe8c172-bab3-4a24-b716-1b536176ef81", "name": "network-vif-plugged", "status": "completed", "tag": "9fa650be-eba1-4201-8c24-eb7b2ec8a90a"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:54.698560 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a9b0c511-1399-48b9-9bd2-0343debe8d26 req-a6d81e17-84a1-4c52-a829-c24080c75fe7 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:54.698963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a9b0c511-1399-48b9-9bd2-0343debe8d26 req-a6d81e17-84a1-4c52-a829-c24080c75fe7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:54.699710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a9b0c511-1399-48b9-9bd2-0343debe8d26 req-a6d81e17-84a1-4c52-a829-c24080c75fe7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:54.713494 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a9b0c511-1399-48b9-9bd2-0343debe8d26 req-a6d81e17-84a1-4c52-a829-c24080c75fe7 service nova] Creating event network-vif-plugged:9fa650be-eba1-4201-8c24-eb7b2ec8a90a for instance ffe8c172-bab3-4a24-b716-1b536176ef81 on hv-cinder-83608 Aug 09 17:59:54.718953 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a9b0c511-1399-48b9-9bd2-0343debe8d26 req-a6d81e17-84a1-4c52-a829-c24080c75fe7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Aug 09 17:59:54.718953 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 254/486] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:55.430827 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:55.431965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:55.441673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:55.442158 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:55.442589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:55.445990 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:55.446458 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:55.446892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:55.579730 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:55.588514 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:55.590017 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:55.591192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-45bf9fad-2219-452c-ac72-76f3ff67f8ca tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.165740 Aug 09 17:59:55.591751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 233/487] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:55 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:56.616019 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:56.616737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:56.622835 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.623344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.623781 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.624457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.625170 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.625585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.751696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:56.760827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:56.762321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:56.763500 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d48a7cda-dd1e-4c2e-a35a-79620cbd3fde tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.151815 Aug 09 17:59:56.764051 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 255/488] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:56 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:57.790460 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:57.791417 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:57.800856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:57.801394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:57.801839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:57.802547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:57.803024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:57.803451 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:57.943334 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:57.951650 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:57.953165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:57.954310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dcdd9ac4-1a4c-4053-84a0-263ef049b52d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1809 microversion: 2.20 time: 0.170305 Aug 09 17:59:57.954876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 234/489] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:57 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:59:58.977717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:58.978336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:58.984396 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:58.984879 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:58.985313 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:58.985999 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:58.986451 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:58.986872 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:59.117706 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:59.126737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:59.128301 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:59.129450 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9469d63b-3fb2-4d47-8160-ca2c8ae6ee89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1796 microversion: 2.20 time: 0.155679 Aug 09 17:59:59.130017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 256/490] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 17:59:58 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:00:06.927555 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:06.928151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:06.930577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=26 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:06.935879 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:06.936362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:06.936797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:06.937486 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:06.937938 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:06.938391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:06.941040 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=69 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:07.064358 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lazy-loading 'services' on Instance uuid 6fc776d4-095b-4bbc-89a9-b99528a089f3 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:07.184730 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e7a7a585-6201-4398-a725-d1240b6226c4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-volume_attachments/801dca03-93e2-4aa1-9d9f-6ec6c4c2611b" status: 202 len: 0 microversion: 2.1 time: 0.260903 Aug 09 18:00:07.185625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 235/491] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:00:06 2022] DELETE /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-volume_attachments/801dca03-93e2-4aa1-9d9f-6ec6c4c2611b => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:08.311540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e7f9cf0-482c-4983-a1aa-9dc4d2b5fb22 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:08.317704 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e7f9cf0-482c-4983-a1aa-9dc4d2b5fb22 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:08.318187 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e7f9cf0-482c-4983-a1aa-9dc4d2b5fb22 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:08.318623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e7f9cf0-482c-4983-a1aa-9dc4d2b5fb22 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:08.381728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9e7f9cf0-482c-4983-a1aa-9dc4d2b5fb22 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Going to try to stop instance {{(pid=117886) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 18:00:08.428403 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9e7f9cf0-482c-4983-a1aa-9dc4d2b5fb22 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action" status: 202 len: 0 microversion: 2.1 time: 0.120816 Aug 09 18:00:08.429040 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 257/492] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:00:08 2022] POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:08.438032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:08.438735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:08.450958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:08.452247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:08.452887 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:08.453612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:08.454300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:08.454745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:08.585876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:08.593555 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3945f3f1-27c9-4e29-9a6b-8b08a4fa4c9a tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.159796 Aug 09 18:00:08.594153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 236/493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:08 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:09.615960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:09.616663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:09.618597 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=22 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:09.624161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:09.624576 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:09.625261 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:09.625944 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:09.626390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:09.626808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:09.983123 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:09.993374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4e0cae1b-5e49-4cde-bdef-e06e26e87d90 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.382192 Aug 09 18:00:09.993957 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 258/494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:09 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:10.764811 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89853a1e-fe2e-4ef7-a2ef-a43fb46c7913"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:10.767180 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:10.773513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:10.773988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:10.774417 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:10.775139 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:10.775591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:10.776013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:11.015126 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:11.015734 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:11.022505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:11.023095 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:11.023535 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:11.024229 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:11.024685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:11.025111 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:11.026512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-96d8acb9-e0df-425e-a0d9-8d2c02110cc1 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265551 Aug 09 18:00:11.027330 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 237/495] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:00:10 2022] POST /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:11.161175 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:11.169683 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-23b5fe7c-8ac5-4ec6-9bfe-44e40f1fac63 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.159932 Aug 09 18:00:11.170258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 259/496] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:11 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:11.872756 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:11.873323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:11.880684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:11.881383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:11.881616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:11.882294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:11.882765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:11.883215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:11.905093 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-43c4fb84-1b99-44aa-a708-1fa8cbc15a5c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5/ips" status: 200 len: 149 microversion: 2.1 time: 0.036547 Aug 09 18:00:11.905652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 238/497] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 18:00:11 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:11.917086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d4299bc-f2d1-4106-86db-843990e24d5c"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:11.919610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:11.925473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:11.925951 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:11.926385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:11.927654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:11.928101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:11.928521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:11.932153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:12.012849 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Invalid volume: volume 7d4299bc-f2d1-4106-86db-843990e24d5c is already attached to instances: 0cbe1d82-6292-4a15-a16f-d0523a939fe7 Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5/os-volume_attachments HTTP/1.1 Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 74 Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:00:12.014554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {"volumeAttachment": {"volumeId": "7d4299bc-f2d1-4106-86db-843990e24d5c"}} Aug 09 18:00:12.016556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Invalid volume: volume 7d4299bc-f2d1-4106-86db-843990e24d5c is already attached to instances: 0cbe1d82-6292-4a15-a16f-d0523a939fe7 Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'server_id': 'ed6b079a-3718-45b9-9707-a39242dc9aa5', 'body': {'volumeAttachment': {'volumeId': '7d4299bc-f2d1-4106-86db-843990e24d5c'}}} Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7d4299bc-f2d1-4106-86db-843990e24d5c is already attached to instances: 0cbe1d82-6292-4a15-a16f-d0523a939fe7 Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:12.017433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7d4299bc-f2d1-4106-86db-843990e24d5c is already attached to instances: 0cbe1d82-6292-4a15-a16f-d0523a939fe7 Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:12.018887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7d4299bc-f2d1-4106-86db-843990e24d5c is already attached to instances: 0cbe1d82-6292-4a15-a16f-d0523a939fe7 Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 400 to user: Invalid volume: volume 7d4299bc-f2d1-4106-86db-843990e24d5c is already attached to instances: 0cbe1d82-6292-4a15-a16f-d0523a939fe7 {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-db30aac2-8bb9-452f-adb3-e618db070dcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103110 Aug 09 18:00:12.020311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 260/498] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:00:11 2022] POST /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:00:12.025094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:12.025600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:12.032055 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:12.032532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:12.032965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:12.033650 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:12.034105 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:12.034526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:12.062443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:00:12.138737 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-39c65778-8f13-446f-b5f9-3bfe2b875bdb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 204 len: 0 microversion: 2.1 time: 0.117151 Aug 09 18:00:12.139394 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 239/499] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:00:12 2022] DELETE /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:00:12.147630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:12.148246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:12.155680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:12.156164 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:12.156617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:12.157331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:12.157778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:12.158200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:12.191845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:12.192567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:12.199334 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:12.199827 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:12.200259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:12.200951 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:12.201401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:12.201864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:12.347818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:12.355949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-40245874-4806-4d97-bd8f-b5586aefa2d3 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1680 microversion: 2.1 time: 0.212144 Aug 09 18:00:12.356521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 261/500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:12 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:12.376998 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:12.384464 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6f083438-c209-459f-9ab6-bca4d0239ce2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.198030 Aug 09 18:00:12.385078 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 240/501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:12 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:13.377901 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:13.378508 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:13.385078 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:13.385554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:13.385979 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:13.386684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:13.387168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:13.387584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:13.405357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:13.406161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:13.412743 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:13.413221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:13.413654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:13.414332 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:13.414775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:13.415228 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:13.572062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:13.579658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-269d7ef3-5916-4666-9d19-bc99693d0fea tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1680 microversion: 2.1 time: 0.205836 Aug 09 18:00:13.580231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 262/502] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:13 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:13.594831 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:13.602184 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-abc72cee-c09d-46dd-a591-5f8f591dad8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.200617 Aug 09 18:00:13.602749 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 241/503] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:13 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:14.600957 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:14.601563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:14.608606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:14.609027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:14.609456 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:14.610133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:14.610582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:14.611025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:14.623576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:14.624193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:14.632302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:14.633050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:14.633658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:14.634369 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:14.634947 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:14.635618 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:14.817167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:14.826860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d18f92b6-ad66-43cf-b2c5-a6e594cf591c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1680 microversion: 2.1 time: 0.229753 Aug 09 18:00:14.829637 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:14.830277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 263/504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:14 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:14.838542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0f42ab41-fc0b-484c-8487-ad1c152a3215 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.218837 Aug 09 18:00:14.839236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 242/505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:14 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:15.457023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-8bfe75da-c0f8-4779-b712-714e380e0ac4 req-2c39d1f7-9eed-4334-b9e5-0bc5b1a48aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6b079a-3718-45b9-9707-a39242dc9aa5", "name": "network-vif-deleted", "tag": "031be3e9-579f-42bf-85e1-5c7d4af44e31"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:15.466489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8bfe75da-c0f8-4779-b712-714e380e0ac4 req-2c39d1f7-9eed-4334-b9e5-0bc5b1a48aa8 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:15.467058 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8bfe75da-c0f8-4779-b712-714e380e0ac4 req-2c39d1f7-9eed-4334-b9e5-0bc5b1a48aa8 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:15.467483 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8bfe75da-c0f8-4779-b712-714e380e0ac4 req-2c39d1f7-9eed-4334-b9e5-0bc5b1a48aa8 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:15.479862 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-8bfe75da-c0f8-4779-b712-714e380e0ac4 req-2c39d1f7-9eed-4334-b9e5-0bc5b1a48aa8 service nova] Creating event network-vif-deleted:031be3e9-579f-42bf-85e1-5c7d4af44e31 for instance ed6b079a-3718-45b9-9707-a39242dc9aa5 on hv-cinder-83608 Aug 09 18:00:15.485215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-8bfe75da-c0f8-4779-b712-714e380e0ac4 req-2c39d1f7-9eed-4334-b9e5-0bc5b1a48aa8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031745 Aug 09 18:00:15.489214 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 264/506] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:15.851878 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:15.853066 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:15.860307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:15.861639 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:15.873425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:15.874176 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:15.874778 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:15.875764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:15.876917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:15.877851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:15.878080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:15.879105 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:15.879747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:15.880885 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:15.881142 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:15.883567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:15.941378 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:15.941866 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:15.942302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:15.943784 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lazy-loading 'fault' on Instance uuid ed6b079a-3718-45b9-9707-a39242dc9aa5 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:16.026805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:16.037612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-31ca11ec-a8c8-4cb1-aa87-d98493477e8e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 200 len: 1331 microversion: 2.1 time: 0.190111 Aug 09 18:00:16.052350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 243/507] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:15 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 1331 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:16.087981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:16.095719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8108c3bb-c007-438b-87b0-dab38daa9024 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.239429 Aug 09 18:00:16.109372 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 265/508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:15 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:17.065127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:17.067938 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:17.074559 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:17.075078 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:17.075520 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:17.076218 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:17.076673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:17.077100 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:17.092323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 HTTP/1.1 Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:00:17.093988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:00:17.095251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'ed6b079a-3718-45b9-9707-a39242dc9aa5'} Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:00:17.096119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:00:17.097277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:17.098415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:00:17.098415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-16bbac00-b4ab-4bf3-b716-b462fc4917ce tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 404 len: 111 microversion: 2.1 time: 0.034186 Aug 09 18:00:17.098415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 244/509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:17 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:00:17.105132 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a6623799-4bc0-4dde-9f92-8a9de29b4c00 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '.version_select at 0x7f8c06a25940>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:17.109572 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a6623799-4bc0-4dde-9f92-8a9de29b4c00 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [63b472cd-4a96-48c3-a1f8-5d2e5eddffdb] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:00:17.116159 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:17.116808 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:17.123043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:17.123496 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:17.123928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:17.124620 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:17.125331 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:17.125752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:17.259205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:17.266657 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-93ac2e02-91cf-41aa-936a-e87814785067 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.154169 Aug 09 18:00:17.267252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 245/510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:17 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:18.116477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [None req-a6623799-4bc0-4dde-9f92-8a9de29b4c00 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [63b472cd-4a96-48c3-a1f8-5d2e5eddffdb] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 41834. Aug 09 18:00:18.135689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a6623799-4bc0-4dde-9f92-8a9de29b4c00 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165843173" status: 202 len: 0 microversion: 2.1 time: 1.034304 Aug 09 18:00:18.136278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 266/511] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 9 18:00:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165843173 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:18.288169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:18.288789 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:18.296792 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.297520 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.299478 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.299478 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.299478 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.299834 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.442264 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:18.451004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c8687cf-2608-4e46-be33-7b835aeeed49 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1678 microversion: 2.1 time: 0.166806 Aug 09 18:00:18.451979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 246/512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:18 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:18.607934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:18.610545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:18.618385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.619189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.619875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.620813 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.621270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.621708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.644806 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'flavor' on Instance uuid 96b85a38-edb0-4b79-aacd-a37285510d9d {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:18.786994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4123c8e4-15cf-4726-97ce-1c24bd71990e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/action" status: 200 len: 32 microversion: 2.1 time: 0.182871 Aug 09 18:00:18.787904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 267/513] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:00:18 2022] POST /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:00:18.800900 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:18.802414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:18.811285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.812306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.813055 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.814032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.814565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.815032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.929512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:18.930321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:18.938057 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.938660 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.939457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.940850 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:18.941533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:18.942321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:18.994888 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:19.004902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-46be1085-fa13-418a-ac3c-f65835883999 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.208661 Aug 09 18:00:19.006552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 247/514] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:18 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:19.077763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lazy-loading 'services' on Instance uuid 0cbe1d82-6292-4a15-a16f-d0523a939fe7 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:19.197162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8eee73de-d4f0-4555-afcd-2c8695c06492 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments/7d4299bc-f2d1-4106-86db-843990e24d5c" status: 202 len: 0 microversion: 2.1 time: 0.272724 Aug 09 18:00:19.198057 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 268/515] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:00:18 2022] DELETE /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments/7d4299bc-f2d1-4106-86db-843990e24d5c => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:00:19.207309 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:19.209565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:19.216515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.216967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.217473 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.218924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.219399 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.220004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.248428 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:19.256113 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-85299a97-3afd-4dc7-9c40-ac9cbdfced15 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052930 Aug 09 18:00:19.256723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 248/516] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:00:19 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:19.473257 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:19.474517 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:19.480719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.481199 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.481632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.482319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.482769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.483225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.615931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:19.623642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d77767e9-0063-4c71-b8c5-b7f5b0a950cc tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1655 microversion: 2.1 time: 0.154685 Aug 09 18:00:19.624225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 269/517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:19 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:19.644863 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cb753bbe-6e49-443e-ac52-ce6ac606197b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:19.653135 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cb753bbe-6e49-443e-ac52-ce6ac606197b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.653624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cb753bbe-6e49-443e-ac52-ce6ac606197b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.654056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cb753bbe-6e49-443e-ac52-ce6ac606197b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.677966 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cb753bbe-6e49-443e-ac52-ce6ac606197b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Going to try to start instance {{(pid=117885) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 18:00:19.721686 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cb753bbe-6e49-443e-ac52-ce6ac606197b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action" status: 202 len: 0 microversion: 2.1 time: 0.081278 Aug 09 18:00:19.722321 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 249/518] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:00:19 2022] POST /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:19.730443 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:19.731301 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:19.737530 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.738404 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.738770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.739747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.740394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.741069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.897054 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:19.904869 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c31f30fc-15a8-44cc-8900-25d3a2c0a3d5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1664 microversion: 2.1 time: 0.178311 Aug 09 18:00:19.905579 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 270/519] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:19 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:20.029082 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:20.031073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:20.040730 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.041420 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.041893 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.042633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.043119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.043558 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.240225 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:20.251261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-efae07f1-c7c6-42f9-8e43-201398d8a5f9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.226985 Aug 09 18:00:20.251834 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 250/520] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:20 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:20.268538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:20.270780 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:20.277362 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.277835 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.278267 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.278950 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.279440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.279832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.312053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-efe436e9-9328-470f-832c-1a586d8f9f77 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047407 Aug 09 18:00:20.312624 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 271/521] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:00:20 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:00:20.374533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:20.375419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:20.381967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.382457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.382898 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.383616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.384072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.384500 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.413032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:00:20.490616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-81139379-55f1-43c4-9bcf-ed6fddd3ef4b tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 204 len: 0 microversion: 2.1 time: 0.118987 Aug 09 18:00:20.494357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 251/522] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:00:20 2022] DELETE /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:00:20.499663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:20.500527 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:20.510436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.510930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.511386 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.512083 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.512533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.512956 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.640092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:20.647524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9a0d5669-2bf5-4073-b41c-b4f3f3a0a2e6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1679 microversion: 2.1 time: 0.151823 Aug 09 18:00:20.648097 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 272/523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:20 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:20.926452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:20.927174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:20.933504 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.933981 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.934410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.935122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.935568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.935983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:21.071257 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:21.078693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-12d69698-a130-4120-afa2-2ef153ef2aed tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1664 microversion: 2.1 time: 0.156418 Aug 09 18:00:21.079290 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 252/524] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:20 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:21.274032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:21.274549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:21.280438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:21.280913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:21.281348 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:21.282025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:21.282475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:21.282895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:21.408880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:21.416936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-40704025-e79f-41de-8f5d-3469449832a0 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.147473 Aug 09 18:00:21.417491 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 273/525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:21 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:21.668512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:21.669122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:21.674965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:21.675471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:21.675903 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:21.676577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:21.677024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:21.677443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:21.807409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:21.814885 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-863d6108-6b62-4486-b9aa-83a369199647 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1679 microversion: 2.1 time: 0.150148 Aug 09 18:00:21.815500 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 253/526] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:21 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:22.099852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:22.100456 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:22.106572 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:22.107088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:22.107520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:22.108211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:22.108662 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:22.109084 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:22.254085 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:22.262046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7ebe9a41-d290-4de3-b14f-301ed0a5eed4 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1664 microversion: 2.1 time: 0.166161 Aug 09 18:00:22.262617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 274/527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:22 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:22.438147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:22.438824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:22.446019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:22.446502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:22.446940 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:22.447662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:22.448119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:22.448548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:22.581795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:22.589981 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6633dc09-cc57-4ee8-a575-23eeb5a4b5ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.156098 Aug 09 18:00:22.590554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 254/528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:22 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:22.836504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:22.837029 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:22.843003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:22.843506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:22.843945 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:22.844636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:22.845090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:22.845519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:22.981370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:22.982943 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:22.990208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fdf800d5-ea16-4d60-b97c-afb2453a4770 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1679 microversion: 2.1 time: 0.157535 Aug 09 18:00:22.990778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 275/529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:22 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:23.283388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:23.283992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:23.289806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:23.290289 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:23.290719 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:23.291442 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:23.291889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:23.292300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:23.419308 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:23.426580 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1c69e85e-fd18-48f4-b2f9-ec5f4ce03d6e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1664 microversion: 2.1 time: 0.146927 Aug 09 18:00:23.427673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 255/530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:23 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:23.611270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:23.611882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:23.619171 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:23.619713 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:23.620152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:23.620846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:23.621297 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:23.621718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:23.863342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:23.877111 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f29f5629-4dc6-4725-b1ce-d8b84bdc3569 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.269615 Aug 09 18:00:23.877865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 276/531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:23 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:24.012065 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:24.012762 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:24.019189 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.019677 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.020111 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.021387 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.021766 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.022192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.213250 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:24.220791 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-419625cb-6840-4745-ab4d-223912a20472 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 200 len: 1679 microversion: 2.1 time: 0.212630 Aug 09 18:00:24.221363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 256/532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:24 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:24.452172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:24.453246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:24.464644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.465514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.466603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.467528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.468356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.469090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.514796 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-1b9f7022-b45a-4c5b-8a58-c54791fea78c req-ca3d41ea-4112-4abe-b921-3fc11506730b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbe1d82-6292-4a15-a16f-d0523a939fe7", "name": "network-vif-deleted", "tag": "c2bfe46e-68c0-434d-be2c-a2ea6aaac310"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:24.527537 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1b9f7022-b45a-4c5b-8a58-c54791fea78c req-ca3d41ea-4112-4abe-b921-3fc11506730b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.528179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1b9f7022-b45a-4c5b-8a58-c54791fea78c req-ca3d41ea-4112-4abe-b921-3fc11506730b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.528623 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1b9f7022-b45a-4c5b-8a58-c54791fea78c req-ca3d41ea-4112-4abe-b921-3fc11506730b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.540914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-1b9f7022-b45a-4c5b-8a58-c54791fea78c req-ca3d41ea-4112-4abe-b921-3fc11506730b service nova] Creating event network-vif-deleted:c2bfe46e-68c0-434d-be2c-a2ea6aaac310 for instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 on hv-cinder-83608 Aug 09 18:00:24.546919 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-1b9f7022-b45a-4c5b-8a58-c54791fea78c req-ca3d41ea-4112-4abe-b921-3fc11506730b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035637 Aug 09 18:00:24.548446 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 257/533] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:00:24.635462 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:24.643819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05581674-9633-4c49-8c0c-45db983eefe0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1668 microversion: 2.1 time: 0.198160 Aug 09 18:00:24.644673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 277/534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:24 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1668 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:24.900524 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:24.901351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:24.907585 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.908073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.908512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.909207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.909661 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.910088 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:25.041639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:25.054150 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9163808d-21fb-4a85-994a-81b7908f2ebb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.157125 Aug 09 18:00:25.055081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 258/535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:24 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:25.243364 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:25.244092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:25.250454 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:25.250936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:25.251395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:25.252085 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:25.252532 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:25.252953 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:25.266655 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 HTTP/1.1 Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:00:25.268327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:00:25.269913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '0cbe1d82-6292-4a15-a16f-d0523a939fe7'} Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:00:25.270774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:00:25.272320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:25.273554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:00:25.273554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b35ad1ac-e4af-45f6-a834-4072c68902c4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 404 len: 111 microversion: 2.1 time: 0.031271 Aug 09 18:00:25.273554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 278/536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:25 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:00:25.278907 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-42748952-4d09-4e3a-8680-d38af99f787f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '.version_select at 0x7f8c067d45e0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:25.301387 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-42748952-4d09-4e3a-8680-d38af99f787f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866948201" status: 202 len: 0 microversion: 2.1 time: 0.026255 Aug 09 18:00:25.302698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 259/537] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 9 18:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866948201 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:25.931165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6f091768-2c3b-4eb8-87e8-c25c494bed91 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: .version_select at 0x7f8c06a25b80>, body: {"keypair": {"name": "tempest-keypair-1151043323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL50b3TDCRlVFFiRsPUhRYjNNiYtH/Q/jEXh4D2oKQOWc3LQh9Dn7PFsjWUr32CocrtT9f71yEDLtiUMf4WpuhhNyUuf992tfWqDTmvAfXZ+gMup8eGWt/MsdIR7s03u7A=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:25.947090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-6f091768-2c3b-4eb8-87e8-c25c494bed91 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:25.950996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-6f091768-2c3b-4eb8-87e8-c25c494bed91 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:25.973684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6f091768-2c3b-4eb8-87e8-c25c494bed91 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046394 Aug 09 18:00:25.974280 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 279/538] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 18:00:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:26.077008 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:26.077824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:26.087255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:26.087770 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:26.088268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:26.089069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:26.089526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:26.089966 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:26.298393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:26.310097 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-87c2fa14-0947-4c6b-bce7-e7f3c480a89b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.237635 Aug 09 18:00:26.310691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 260/539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:26 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:27.332678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:27.333278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:27.340330 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.341064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.341499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.342388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.342839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.343455 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.535589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:27.543630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9e23b4a9-b178-477c-913c-7e12d7af8f13 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.215261 Aug 09 18:00:27.544200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 280/540] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:27 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:27.609054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1952336573", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f6bff3-89eb-4947-b35c-63d3a99a9190"}], "security_groups": [{"name": "tempest-securitygroup--1152294961"}], "key_name": "tempest-keypair-1151043323", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:27.711364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] validate_networks() for [('88f6bff3-89eb-4947-b35c-63d3a99a9190', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:00:28.081874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:00:28.082300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:00:28.082786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:00:28.083229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:00:28.083643 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:00:28.093016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.093499 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.093930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.094652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.095139 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.095564 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.112084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:28.116141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:28.127184 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:00:28.129396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:00:28.176192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-df62afa8-3419-4451-a2a9-9845113a00f5 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571479 Aug 09 18:00:28.176831 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 261/541] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:00:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:00:28.187651 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-18955e51-993b-4353-a025-592b135626e9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:28.188255 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-18955e51-993b-4353-a025-592b135626e9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:28.240772 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-18955e51-993b-4353-a025-592b135626e9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:28.247497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-18955e51-993b-4353-a025-592b135626e9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1242 microversion: 2.1 time: 0.063655 Aug 09 18:00:28.248063 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 281/542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:28 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:28.564698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:28.565312 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:28.574118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.574609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.575085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.575822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.576278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.576715 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.717012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:28.725395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-80d3e25b-2283-4fef-b5ec-19ff8e25e435 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.164140 Aug 09 18:00:28.725952 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 262/543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:28 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:29.273573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:29.274666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:29.283860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.284458 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.284942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.285717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.286200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.286654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.397630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:29.406318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-666bf2ee-84df-4116-a6b9-e810989821af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1302 microversion: 2.1 time: 0.140650 Aug 09 18:00:29.406898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 282/544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:29 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:29.747732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:29.748484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:29.755741 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.756732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.757194 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.757874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.758319 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.758742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.956289 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:29.964401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b47cfb05-1155-498d-9bbd-8e25dd86ff80 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.220941 Aug 09 18:00:29.964905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 263/545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:29 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:30.430931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:30.431475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:30.437511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.437984 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.438406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:30.439206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.439650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.440066 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:30.652539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:30.660009 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6185f79d-ab73-4bd9-8a54-a74cd030ed79 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.234429 Aug 09 18:00:30.660582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 283/546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:30 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:30.909122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b60f2ed4-7893-445a-91b4-4e587d0f7caf req-85203974-bfbe-47d0-a298-d59a1c083a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583dd4cf-1ee5-4244-bec6-a9fc62f38403", "tag": "f3051d76-2d8c-47bb-838a-d056bb6d6a21"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:30.920748 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b60f2ed4-7893-445a-91b4-4e587d0f7caf req-85203974-bfbe-47d0-a298-d59a1c083a02 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.921350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b60f2ed4-7893-445a-91b4-4e587d0f7caf req-85203974-bfbe-47d0-a298-d59a1c083a02 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.921829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b60f2ed4-7893-445a-91b4-4e587d0f7caf req-85203974-bfbe-47d0-a298-d59a1c083a02 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:30.941405 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b60f2ed4-7893-445a-91b4-4e587d0f7caf req-85203974-bfbe-47d0-a298-d59a1c083a02 service nova] Creating event network-changed:f3051d76-2d8c-47bb-838a-d056bb6d6a21 for instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 on hv-cinder-83608 Aug 09 18:00:30.947339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b60f2ed4-7893-445a-91b4-4e587d0f7caf req-85203974-bfbe-47d0-a298-d59a1c083a02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042265 Aug 09 18:00:30.948094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 264/547] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:30.985704 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:30.986305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:30.992442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.992928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.993359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:30.994349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.994503 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.994920 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:31.216220 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:31.224448 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9112cdf-4d3c-4f7d-87a5-62f411093b21 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.242586 Aug 09 18:00:31.225029 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 284/548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:30 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:31.684329 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:31.685104 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:31.691314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:31.691798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:31.692238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:31.692930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:31.693388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:31.694311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:31.835814 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:31.838109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:31.844685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d676dae-7a98-4460-ad1e-e4fa29242963 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.164677 Aug 09 18:00:31.845265 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 265/549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:31 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:32.246552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:32.247212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:32.253440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.253921 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.254356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.255083 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.255539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.255960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.383642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:32.391595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec75c74b-e530-46f0-acd7-fcaf7e5a0b6c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.148964 Aug 09 18:00:32.392166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 285/550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:32 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:32.865290 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:32.866501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:32.873495 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.874059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.874584 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.875619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.876138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.876560 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:33.088940 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:33.096647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-703e8274-712d-4a9e-83b9-beafda49accb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.235882 Aug 09 18:00:33.097233 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 266/551] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:32 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:33.413335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:33.414023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:33.419990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:33.420468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:33.420892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:33.422144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:33.422596 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:33.423044 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:33.549283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:33.557842 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9a180ee-914f-421c-a817-e475caa3d1b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.149068 Aug 09 18:00:33.558406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 286/552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:33 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:34.117206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:34.117819 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:34.124290 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:34.124771 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:34.125723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:34.126167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:34.126609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:34.127056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:34.255172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:34.263037 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e8438c89-fc2f-4c52-950b-afa76806a497 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.149687 Aug 09 18:00:34.263602 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 267/553] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:34 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:34.578671 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:34.579329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:34.585340 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:34.585822 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:34.586260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:34.586946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:34.587430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:34.587857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:34.952113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:34.960150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5c1b86fa-0052-4062-a14d-cf756e0a77eb tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.385303 Aug 09 18:00:34.960674 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 287/554] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:34 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:35.288013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:35.288649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:35.295160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:35.295641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:35.296079 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:35.296795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:35.297247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:35.297668 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:35.426265 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:35.433985 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b51adb3-477a-4432-b1c4-57b02f253aeb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.150313 Aug 09 18:00:35.434501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 268/555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:35 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:35.983311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:35.983854 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:35.989845 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:35.990827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:35.991353 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:35.992037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:35.992491 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:35.992912 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:36.123745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:36.132630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2e9afa64-5423-4322-9854-0fd68a421e53 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.153402 Aug 09 18:00:36.133194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 288/556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:35 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:36.455096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:36.455716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:36.458039 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:36.464249 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:36.464740 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:36.465181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:36.465875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:36.466330 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:36.466753 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:36.606944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:36.614365 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d59ea205-63f9-45ee-80d8-3142a14db144 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.163132 Aug 09 18:00:36.614939 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 269/557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:36 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:36.869947 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4a42fcec-91f0-47fb-a995-04ba7625b6d1 req-34657ed5-5cdd-4703-8f6c-3d6aec19d43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583dd4cf-1ee5-4244-bec6-a9fc62f38403", "name": "network-vif-plugged", "status": "completed", "tag": "f3051d76-2d8c-47bb-838a-d056bb6d6a21"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:36.879743 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4a42fcec-91f0-47fb-a995-04ba7625b6d1 req-34657ed5-5cdd-4703-8f6c-3d6aec19d43d service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:36.880282 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4a42fcec-91f0-47fb-a995-04ba7625b6d1 req-34657ed5-5cdd-4703-8f6c-3d6aec19d43d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:36.880737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4a42fcec-91f0-47fb-a995-04ba7625b6d1 req-34657ed5-5cdd-4703-8f6c-3d6aec19d43d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:36.892441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4a42fcec-91f0-47fb-a995-04ba7625b6d1 req-34657ed5-5cdd-4703-8f6c-3d6aec19d43d service nova] Creating event network-vif-plugged:f3051d76-2d8c-47bb-838a-d056bb6d6a21 for instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 on hv-cinder-83608 Aug 09 18:00:36.898005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4a42fcec-91f0-47fb-a995-04ba7625b6d1 req-34657ed5-5cdd-4703-8f6c-3d6aec19d43d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031781 Aug 09 18:00:36.898605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 289/558] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:37.154808 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:37.155564 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:37.162116 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:37.162608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:37.163081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:37.163782 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:37.164240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:37.164666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:37.322206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:37.330403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e642ef21-3197-4090-a408-cb57f327a087 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1735 microversion: 2.1 time: 0.179767 Aug 09 18:00:37.330988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 270/559] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:37 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:37.637089 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:37.637779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:37.644163 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:37.644632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:37.645057 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:37.645727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:37.646168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:37.646585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:37.784598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:37.792481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a8061dce-c8a3-4244-872e-311b2232d5d9 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.159600 Aug 09 18:00:37.793043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 290/560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:37 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:38.350962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:38.351592 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:38.353898 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:38.354548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:38.360074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.360550 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.361035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.361725 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.362171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.362591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.512720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:38.520673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-65756329-8fcc-4d95-a2c7-e5dac26f234b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1715 microversion: 2.1 time: 0.173512 Aug 09 18:00:38.521258 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 271/561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:38 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:38.634525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:38.635058 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:38.637122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:38.642649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.643242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.643674 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.644571 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.645031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.645457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.726944 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] HTTP exception thrown: Cannot 'detach_volume' instance 96b85a38-edb0-4b79-aacd-a37285510d9d while it is in vm_state rescued Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Request method failure captured: Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments/89853a1e-fe2e-4ef7-a2ef-a43fb46c7913 HTTP/1.1 Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_ENkpffXr2zSFxwPtM5XL1o7MLekOa5K8bYYPQiqjiHWveoX5QSNnPRZM-hoZhfIhsubxQJlulV7XFSpcLhF3owFmm14AcXqnzKD5Pu7E5WhY405oX6swzCqnqYPjAUYa9hAj1eoZohAVi8k209pGy_OpP64jT8E9usg9v29Jd6N4 Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:00:38.728675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13cf0de2979c44a08f500430834617d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13cf0de2979c44a08f500430834617d2", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: f7491479bd88425f8234e0b1d0e11e55 Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:00:38.730334 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Cannot 'detach_volume' instance 96b85a38-edb0-4b79-aacd-a37285510d9d while it is in vm_state rescued Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'server_id': '96b85a38-edb0-4b79-aacd-a37285510d9d', 'id': '89853a1e-fe2e-4ef7-a2ef-a43fb46c7913'} Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 96b85a38-edb0-4b79-aacd-a37285510d9d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:00:38.731167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 96b85a38-edb0-4b79-aacd-a37285510d9d while it is in vm_state rescued Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 96b85a38-edb0-4b79-aacd-a37285510d9d while it is in vm_state rescued Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:00:38.732696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Returning 409 to user: Cannot 'detach_volume' instance 96b85a38-edb0-4b79-aacd-a37285510d9d while it is in vm_state rescued {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:00:38.733857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-55e9eaba-b787-4a60-bcb5-324639d78e61 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "DELETE /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments/89853a1e-fe2e-4ef7-a2ef-a43fb46c7913" status: 409 len: 152 microversion: 2.1 time: 0.099786 Aug 09 18:00:38.733857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 291/562] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:00:38 2022] DELETE /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments/89853a1e-fe2e-4ef7-a2ef-a43fb46c7913 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 18:00:38.739526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:38.740054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:38.746583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.747102 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.747720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.748559 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.749059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.749516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.813525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:38.814349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:38.817134 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fef12856-8024-433d-a084-f12588e1c06a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "POST /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/action" status: 202 len: 0 microversion: 2.1 time: 0.081651 Aug 09 18:00:38.817923 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 272/563] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:00:38 2022] POST /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:38.821848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.822409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.822796 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.823434 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.823879 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.824296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.826722 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:38.827462 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:38.833633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.834635 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.835112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.835809 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:38.836258 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:38.836681 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:39.024993 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:39.029213 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:39.032364 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ad8b71e7-6208-4a4d-85af-73e388fc5008 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1368 microversion: 2.1 time: 0.222592 Aug 09 18:00:39.032932 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 292/564] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:38 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:39.037966 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0f54c04a-b6c3-48d0-b71b-8e41d48fddb8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1723 microversion: 2.1 time: 0.215031 Aug 09 18:00:39.038608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 273/565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:38 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:40.056369 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:40.058221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:40.060141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:40.060823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:40.062071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:40.068760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:40.069351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:40.069795 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:40.070438 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:40.070574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:40.070934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:40.071092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:40.071395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:40.071519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:40.072576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:40.072674 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:40.073067 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:40.338895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:40.347752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:40.348922 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d935a14a-295c-4ab5-a1ad-6951e1c306a7 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1556 microversion: 2.1 time: 0.298224 Aug 09 18:00:40.349564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 293/566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:40 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1556 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:40.358909 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ecdc4ecb-e9e0-4f18-8822-68944f80be7c tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1723 microversion: 2.1 time: 0.302379 Aug 09 18:00:40.360045 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 274/567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:40 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:40.372321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:40.372819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:40.378962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:40.379493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:40.380082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:40.380770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:40.381213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:40.381631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:40.511481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a04779ed-301a-40ec-b424-0375dc6e4487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143317 Aug 09 18:00:40.512081 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 294/568] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 18:00:40 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:41.380965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:41.381574 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:41.388269 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:41.388760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:41.389199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:41.389901 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:41.390356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:41.390778 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:41.456600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a28f1376-ec82-490c-b87a-ddeeb557cc48 req-349957ac-83f5-4fc5-852c-22691e909083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583dd4cf-1ee5-4244-bec6-a9fc62f38403", "tag": "f3051d76-2d8c-47bb-838a-d056bb6d6a21"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:41.467996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a28f1376-ec82-490c-b87a-ddeeb557cc48 req-349957ac-83f5-4fc5-852c-22691e909083 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:41.468779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a28f1376-ec82-490c-b87a-ddeeb557cc48 req-349957ac-83f5-4fc5-852c-22691e909083 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:41.469455 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a28f1376-ec82-490c-b87a-ddeeb557cc48 req-349957ac-83f5-4fc5-852c-22691e909083 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:41.486647 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a28f1376-ec82-490c-b87a-ddeeb557cc48 req-349957ac-83f5-4fc5-852c-22691e909083 service nova] Creating event network-changed:f3051d76-2d8c-47bb-838a-d056bb6d6a21 for instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 on hv-cinder-83608 Aug 09 18:00:41.491710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a28f1376-ec82-490c-b87a-ddeeb557cc48 req-349957ac-83f5-4fc5-852c-22691e909083 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039053 Aug 09 18:00:41.492318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 295/569] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:00:41.536030 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:41.546525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-acf22bdb-f8ae-4993-9f61-c574c8a67cc8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1723 microversion: 2.1 time: 0.169412 Aug 09 18:00:41.547068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 275/570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:41 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:42.568022 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:42.568744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:42.575035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:42.575535 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:42.576019 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:42.576711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:42.577156 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:42.577614 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:42.754228 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:42.756686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:42.766119 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-892116f1-8c07-49f5-aa80-c9f8a8f60108 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1723 microversion: 2.1 time: 0.201853 Aug 09 18:00:42.772254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 296/571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:42 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:43.789341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:43.789946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:43.797152 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:43.797653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:43.798094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:43.798812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:43.799314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:43.800098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:44.007967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:44.016544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d36a599-8aeb-4631-91dc-4191e166c179 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1729 microversion: 2.1 time: 0.232009 Aug 09 18:00:44.017236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 276/572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:43 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:44.045172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:44.045744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:44.051580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:44.052059 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:44.052493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:44.053751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:44.054201 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:44.054623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:44.135878 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fba1712-848d-47ed-9145-377e1c689bf8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094562 Aug 09 18:00:44.136675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 297/573] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 18:00:44 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:45.036593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-32cbca82-d49c-45db-9d08-74e8bec703ef req-e5022464-dd0b-4172-b25b-0b55d7a7e9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b85a38-edb0-4b79-aacd-a37285510d9d", "tag": "6a6de140-539e-4abe-b62f-b0a3cb0ddffc"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:45.046141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-32cbca82-d49c-45db-9d08-74e8bec703ef req-e5022464-dd0b-4172-b25b-0b55d7a7e9a4 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:45.046745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-32cbca82-d49c-45db-9d08-74e8bec703ef req-e5022464-dd0b-4172-b25b-0b55d7a7e9a4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:45.047983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-32cbca82-d49c-45db-9d08-74e8bec703ef req-e5022464-dd0b-4172-b25b-0b55d7a7e9a4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:45.062133 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-32cbca82-d49c-45db-9d08-74e8bec703ef req-e5022464-dd0b-4172-b25b-0b55d7a7e9a4 service nova] Creating event network-changed:6a6de140-539e-4abe-b62f-b0a3cb0ddffc for instance 96b85a38-edb0-4b79-aacd-a37285510d9d on hv-cinder-83608 Aug 09 18:00:45.073505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-32cbca82-d49c-45db-9d08-74e8bec703ef req-e5022464-dd0b-4172-b25b-0b55d7a7e9a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039580 Aug 09 18:00:45.074137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 277/574] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:00:47.088559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-33957851-26ce-465e-a2e0-c5f74339094e req-d76927c5-0688-4da4-aa82-095cad73a447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b85a38-edb0-4b79-aacd-a37285510d9d", "tag": "6a6de140-539e-4abe-b62f-b0a3cb0ddffc"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:47.102189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-33957851-26ce-465e-a2e0-c5f74339094e req-d76927c5-0688-4da4-aa82-095cad73a447 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:47.102189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-33957851-26ce-465e-a2e0-c5f74339094e req-d76927c5-0688-4da4-aa82-095cad73a447 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:47.102458 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-33957851-26ce-465e-a2e0-c5f74339094e req-d76927c5-0688-4da4-aa82-095cad73a447 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:47.114003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-33957851-26ce-465e-a2e0-c5f74339094e req-d76927c5-0688-4da4-aa82-095cad73a447 service nova] Creating event network-changed:6a6de140-539e-4abe-b62f-b0a3cb0ddffc for instance 96b85a38-edb0-4b79-aacd-a37285510d9d on hv-cinder-83608 Aug 09 18:00:47.118853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-33957851-26ce-465e-a2e0-c5f74339094e req-d76927c5-0688-4da4-aa82-095cad73a447 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 Aug 09 18:00:47.119480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 298/575] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:00:47.744275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:47.744859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:47.751366 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:47.751819 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:47.752272 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:47.752964 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:47.753434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:47.753837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:47.782679 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dcc533ce-0cae-4be0-9485-dc3f6a165ce3 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments/40db782f-e05e-4b79-8555-441c5da169c2" status: 200 len: 194 microversion: 2.20 time: 0.043274 Aug 09 18:00:47.783301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 278/576] 10.222.0.52 () {60 vars in 1454 bytes} [Tue Aug 9 18:00:47 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments/40db782f-e05e-4b79-8555-441c5da169c2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:00:47.856968 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:47.857541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:47.863598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:47.864067 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:47.864489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:47.865707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:47.866147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:47.866559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:47.945981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lazy-loading 'services' on Instance uuid ffe8c172-bab3-4a24-b716-1b536176ef81 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:48.025814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f792edd7-584b-4dba-916e-23714797489f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments/40db782f-e05e-4b79-8555-441c5da169c2" status: 202 len: 0 microversion: 2.20 time: 0.173021 Aug 09 18:00:48.026487 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 299/577] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Aug 9 18:00:47 2022] DELETE /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments/40db782f-e05e-4b79-8555-441c5da169c2 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:00:48.035127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:48.037556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:48.043931 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:48.044479 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:48.044857 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:48.045650 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:48.046142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:48.046588 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:48.078519 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c7dfbfdc-64a7-4978-9c89-8f668b64e53f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047368 Aug 09 18:00:48.079115 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 279/578] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 9 18:00:48 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:00:49.091901 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:49.094127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:49.100380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.100861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.101292 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.101986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.102474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.102940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.136763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-97f4f223-71b8-4cfb-96a1-36d6e520a2da tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049277 Aug 09 18:00:49.137420 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 300/579] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 9 18:00:49 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:49.200156 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:49.200664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:49.207282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.207760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.208191 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.208907 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.209889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.210306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.235000 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:00:49.280607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:49.312423 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2cdd8024-8561-459e-85be-7e28a4733250 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 204 len: 0 microversion: 2.20 time: 0.115954 Aug 09 18:00:49.313019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 280/580] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 9 18:00:49 2022] DELETE /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:00:49.322199 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:49.322841 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:49.328887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.329365 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.329793 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.330582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.331053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.331480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.469294 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:49.477127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:49.478621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:49.479788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-046feaf2-5ecf-4711-a421-034e1fddb407 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.162276 Aug 09 18:00:49.480347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 301/581] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:49 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:00:50.504177 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:50.504877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:50.511414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:50.511895 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:50.512332 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:50.513024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:50.513475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:50.513896 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:50.644670 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:50.652786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:50.654299 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:50.655486 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b93b16b4-3f79-4bdd-b8a3-c0c4d4406164 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.155875 Aug 09 18:00:50.656052 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 281/582] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:50 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:00:51.682791 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:51.683488 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:51.689597 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:51.690009 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:51.690431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:51.691138 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:51.691582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:51.691998 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:51.906644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:51.915209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:51.916831 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:51.918005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-17c9f7cb-fb03-4d7f-aedc-41d5e284a2ef tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1724 microversion: 2.20 time: 0.239513 Aug 09 18:00:51.918571 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 302/583] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:51 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:00:52.562356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-0da916df-3c73-49fe-878a-5c9f27455ea4 req-af396893-7f1b-44de-aa0c-7aedd25ad3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe8c172-bab3-4a24-b716-1b536176ef81", "name": "network-vif-deleted", "tag": "9fa650be-eba1-4201-8c24-eb7b2ec8a90a"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:52.574950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0da916df-3c73-49fe-878a-5c9f27455ea4 req-af396893-7f1b-44de-aa0c-7aedd25ad3e3 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:52.575541 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0da916df-3c73-49fe-878a-5c9f27455ea4 req-af396893-7f1b-44de-aa0c-7aedd25ad3e3 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:52.576192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0da916df-3c73-49fe-878a-5c9f27455ea4 req-af396893-7f1b-44de-aa0c-7aedd25ad3e3 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:52.590897 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-0da916df-3c73-49fe-878a-5c9f27455ea4 req-af396893-7f1b-44de-aa0c-7aedd25ad3e3 service nova] Creating event network-vif-deleted:9fa650be-eba1-4201-8c24-eb7b2ec8a90a for instance ffe8c172-bab3-4a24-b716-1b536176ef81 on hv-cinder-83608 Aug 09 18:00:52.596731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-0da916df-3c73-49fe-878a-5c9f27455ea4 req-af396893-7f1b-44de-aa0c-7aedd25ad3e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037948 Aug 09 18:00:52.599204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 282/584] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:52.942083 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:52.942691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:52.949441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:52.949864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:52.950294 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:52.951011 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:52.951469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:52.951894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:52.984737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:52.985236 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:52.985664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:52.986099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lazy-loading 'fault' on Instance uuid ffe8c172-bab3-4a24-b716-1b536176ef81 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:53.033245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:53.041099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:53.042623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:53.043808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b34d4773-be45-4f19-845c-50de78ef8d6f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 200 len: 1372 microversion: 2.20 time: 0.105766 Aug 09 18:00:53.044360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 303/585] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:52 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:00:54.073407 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:54.075073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:54.081125 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:54.081609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:54.082046 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:54.082745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:54.083227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:54.083654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:54.100053 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] HTTP exception thrown: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Request method failure captured: Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 HTTP/1.1 Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_JLzgDxXS3UAUeldXlOM3_Z3f_nBnNqREJABXNNV4894RcJBEPeLt8negLr_JNBWdKuzTS4pHMp7p8H_SZ1qmhQyExL5t4KUfrPgESaVJ97MMt-6eT7iWay0GQMXaOnoKncEbD-cbRM-IgMxBc195K_ikyY0IarZHDUR27m2hrPfI Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:00:54.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b320e561ec5450682ed979963c392a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b320e561ec5450682ed979963c392a0", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 18bf10b172e7450a9b618683643ed48e Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:00:54.103401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'ffe8c172-bab3-4a24-b716-1b536176ef81'} Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:00:54.104391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:00:54.105851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:00:54.107338 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Returning 404 to user: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:00:54.107338 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a927e97-9d1d-4b7b-8e04-f82f7be02b78 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 404 len: 111 microversion: 2.20 time: 0.036987 Aug 09 18:00:54.107338 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 283/586] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:54 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:00:54.112217 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6d795530-a52c-4dd7-9e63-0ecb675dc836 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '.version_select at 0x7f8c068ce310>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:54.131150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6d795530-a52c-4dd7-9e63-0ecb675dc836 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472800528" status: 204 len: 0 microversion: 2.20 time: 0.022646 Aug 09 18:00:54.131724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 304/587] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Aug 9 18:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472800528 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:00:54.810237 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-caa4ea16-f217-4da3-adec-7440adea6ae2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'create', calling method: .version_select at 0x7f8c067d4ca0>, body: {"keypair": {"name": "tempest-keypair-704370108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbd2s7wwa4YXyFNWxpSZ1P7f0PdVRIi95gdoSYs1uhrKmJDVH5524xgjkXk52n76yeXb22DVNEmo7T8DMtVwXB1pFUO9/wtLEq35c41Dd9a6hS1UFIHhjCn5kdLoaOSMg=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:54.826547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-caa4ea16-f217-4da3-adec-7440adea6ae2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for project 3b320e561ec5450682ed979963c392a0. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:54.830480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-caa4ea16-f217-4da3-adec-7440adea6ae2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for user 18bf10b172e7450a9b618683643ed48e and project 3b320e561ec5450682ed979963c392a0. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:54.852859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-caa4ea16-f217-4da3-adec-7440adea6ae2 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046474 Aug 09 18:00:54.853449 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 284/588] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Aug 9 18:00:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 18:00:56.183656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1192376772", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6247f242-ae61-4c03-a0d7-0070d194bcfa"}], "security_groups": [{"name": "tempest-securitygroup--158896264"}], "key_name": "tempest-keypair-704370108", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:56.294020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] validate_networks() for [('6247f242-ae61-4c03-a0d7-0070d194bcfa', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:00:56.674711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:00:56.675180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:00:56.675658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:00:56.676063 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:00:56.676475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:00:56.686244 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:56.686717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:56.687187 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:56.687915 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:56.688367 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:56.688787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:56.705525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for project 3b320e561ec5450682ed979963c392a0. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:56.709517 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Getting quotas for user 18bf10b172e7450a9b618683643ed48e and project 3b320e561ec5450682ed979963c392a0. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:56.720782 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:00:56.723064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:00:56.773168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f808652d-d45a-427e-b8d0-1be182fc59b9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.594096 Aug 09 18:00:56.774153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 305/589] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Aug 9 18:00:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 18:00:56.784928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c5903ed-8e9b-4ac5-b545-3a0e1202ac4a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:56.785544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c5903ed-8e9b-4ac5-b545-3a0e1202ac4a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:56.845939 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c5903ed-8e9b-4ac5-b545-3a0e1202ac4a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:56.853927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c5903ed-8e9b-4ac5-b545-3a0e1202ac4a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:56.855627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c5903ed-8e9b-4ac5-b545-3a0e1202ac4a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:56.856596 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c5903ed-8e9b-4ac5-b545-3a0e1202ac4a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1281 microversion: 2.20 time: 0.075661 Aug 09 18:00:56.857154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 285/590] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:56 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:00:57.879411 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:57.881435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:57.888591 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:57.889352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:57.890084 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:57.891191 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:57.891797 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:57.892425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:57.972870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:57.983943 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:57.985929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:57.986843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-720c4c4f-413d-409f-a295-a4cd20181145 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1351 microversion: 2.20 time: 0.111808 Aug 09 18:00:57.987931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 306/591] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:57 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:00:59.012259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:59.012988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:59.019680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:59.020266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:59.020744 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:59.022074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:59.022577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:59.023023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:59.261137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:59.271835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:59.273619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:59.274613 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9265abbb-427e-475c-82bc-6b420b822061 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1406 microversion: 2.20 time: 0.267047 Aug 09 18:00:59.275399 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 286/592] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:00:59 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:00:59.396750 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-b3f0eb62-2169-4c06-a47d-2ca93ee41acc req-8be51e2f-70a3-438e-b783-9253fec249c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6e12fe-4b50-43ad-a12e-49a0575a710a", "tag": "01b7a043-db0a-49c0-9549-758464cbc252"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:59.410837 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b3f0eb62-2169-4c06-a47d-2ca93ee41acc req-8be51e2f-70a3-438e-b783-9253fec249c5 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:59.412650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b3f0eb62-2169-4c06-a47d-2ca93ee41acc req-8be51e2f-70a3-438e-b783-9253fec249c5 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:59.413262 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b3f0eb62-2169-4c06-a47d-2ca93ee41acc req-8be51e2f-70a3-438e-b783-9253fec249c5 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:59.426147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-b3f0eb62-2169-4c06-a47d-2ca93ee41acc req-8be51e2f-70a3-438e-b783-9253fec249c5 service nova] Creating event network-changed:01b7a043-db0a-49c0-9549-758464cbc252 for instance ff6e12fe-4b50-43ad-a12e-49a0575a710a on hv-cinder-83608 Aug 09 18:00:59.431510 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-b3f0eb62-2169-4c06-a47d-2ca93ee41acc req-8be51e2f-70a3-438e-b783-9253fec249c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Aug 09 18:00:59.432144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 307/593] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:00.303302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:00.303919 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:00.310571 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:00.311089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:00.311531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:00.312227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:00.312679 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:00.313102 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:00.469250 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:00.477714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:00.479297 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:00.480473 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b55ebe11-5753-402c-a6ac-966ba2f38cf0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1406 microversion: 2.20 time: 0.182136 Aug 09 18:01:00.481038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 287/594] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:00 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:01:01.504068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:01.504895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:01.511071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:01.511554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:01.511984 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:01.512676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:01.513128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:01.513550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:01.719400 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:01.727868 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:01.729365 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:01.730464 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fa5136c8-967e-42fe-a8fd-82aa1c6624d1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1406 microversion: 2.20 time: 0.230909 Aug 09 18:01:01.731040 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 308/595] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:01 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:01:02.754200 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:02.754848 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:02.763582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:02.764092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:02.764861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:02.766082 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:02.769764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:02.769764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:02.904494 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:02.913083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:02.914586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:02.915719 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b93667fe-f0ba-432b-81ad-0c2fe6e7c8cc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1406 microversion: 2.20 time: 0.165854 Aug 09 18:01:02.916284 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 288/596] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:02 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:01:03.938056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:03.938665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:03.945282 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:03.945764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:03.946200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:03.947003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:03.947445 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:03.947865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:04.128897 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:04.137435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:04.138924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:04.140073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82f3c7a6-ed14-4db8-bd2b-65d56544d028 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1406 microversion: 2.20 time: 0.205942 Aug 09 18:01:04.140637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 309/597] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:03 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:01:04.953468 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b3a1cbcd-33a2-4e20-9c60-863fbb33c7fd req-69c0b00e-a74c-4692-ad23-fb172cfbcf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6e12fe-4b50-43ad-a12e-49a0575a710a", "name": "network-vif-plugged", "status": "completed", "tag": "01b7a043-db0a-49c0-9549-758464cbc252"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:04.963727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b3a1cbcd-33a2-4e20-9c60-863fbb33c7fd req-69c0b00e-a74c-4692-ad23-fb172cfbcf40 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:04.964240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b3a1cbcd-33a2-4e20-9c60-863fbb33c7fd req-69c0b00e-a74c-4692-ad23-fb172cfbcf40 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:04.964872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b3a1cbcd-33a2-4e20-9c60-863fbb33c7fd req-69c0b00e-a74c-4692-ad23-fb172cfbcf40 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:04.978490 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b3a1cbcd-33a2-4e20-9c60-863fbb33c7fd req-69c0b00e-a74c-4692-ad23-fb172cfbcf40 service nova] Creating event network-vif-plugged:01b7a043-db0a-49c0-9549-758464cbc252 for instance ff6e12fe-4b50-43ad-a12e-49a0575a710a on hv-cinder-83608 Aug 09 18:01:04.983576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b3a1cbcd-33a2-4e20-9c60-863fbb33c7fd req-69c0b00e-a74c-4692-ad23-fb172cfbcf40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034625 Aug 09 18:01:04.984391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 289/598] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:01:05.163880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:05.164593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:05.170405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:05.170888 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:05.171361 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:05.172044 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:05.172490 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:05.172901 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:05.335317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:05.343349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:05.344855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:05.345990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5090f278-826d-4fbf-b30b-5f4373641266 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1406 microversion: 2.20 time: 0.186661 Aug 09 18:01:05.346557 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 310/599] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:05 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:01:06.369704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:06.370408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:06.377542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:06.378027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:06.378463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:06.379206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:06.379660 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:06.380083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:06.569062 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:06.578582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:06.580129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:06.581233 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cf6e356d-3dea-414c-b2dc-f7e498386c1e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1406 microversion: 2.20 time: 0.215914 Aug 09 18:01:06.581888 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 290/600] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:06 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:01:07.604065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:07.604940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:07.610041 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:07.610719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:07.612576 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:07.613147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:07.613614 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:07.614317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:07.614766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:07.615219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:07.842329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:07.851660 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:07.854554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:07.855775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8ceac32d-dacc-4f92-9f62-af391e83def1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1599 microversion: 2.20 time: 0.256225 Aug 09 18:01:07.856628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 311/601] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:07 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1599 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:01:07.882087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:07.882828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:07.884793 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:07.885948 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:07.892017 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:07.892516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:07.892984 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:07.893695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:07.894148 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:07.894575 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:07.994902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-aec543fe-2c4b-4650-b494-1667c340804b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.116965 Aug 09 18:01:08.002731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 291/602] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Aug 9 18:01:07 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:01:09.186803 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-2812f120-238c-4677-b0e7-4ebddccba7ee req-fc59797b-07e4-4d11-986a-54dc7b1bf18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6e12fe-4b50-43ad-a12e-49a0575a710a", "tag": "01b7a043-db0a-49c0-9549-758464cbc252"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:09.196789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2812f120-238c-4677-b0e7-4ebddccba7ee req-fc59797b-07e4-4d11-986a-54dc7b1bf18c service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:09.197261 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2812f120-238c-4677-b0e7-4ebddccba7ee req-fc59797b-07e4-4d11-986a-54dc7b1bf18c service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:09.197682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2812f120-238c-4677-b0e7-4ebddccba7ee req-fc59797b-07e4-4d11-986a-54dc7b1bf18c service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:09.208922 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-2812f120-238c-4677-b0e7-4ebddccba7ee req-fc59797b-07e4-4d11-986a-54dc7b1bf18c service nova] Creating event network-changed:01b7a043-db0a-49c0-9549-758464cbc252 for instance ff6e12fe-4b50-43ad-a12e-49a0575a710a on hv-cinder-83608 Aug 09 18:01:09.214693 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-2812f120-238c-4677-b0e7-4ebddccba7ee req-fc59797b-07e4-4d11-986a-54dc7b1bf18c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031426 Aug 09 18:01:09.215563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 312/603] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:26.105480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:26.106270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:26.110797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:26.111352 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:26.118526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:26.119080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:26.119523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:26.120217 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:26.120671 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:26.121098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:26.200131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'services' on Instance uuid 96b85a38-edb0-4b79-aacd-a37285510d9d {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:26.273311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cfd8fad9-5ee9-45bb-aa53-888c729ae4c2 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "DELETE /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments/89853a1e-fe2e-4ef7-a2ef-a43fb46c7913" status: 202 len: 0 microversion: 2.1 time: 0.169088 Aug 09 18:01:26.273915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 292/604] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:01:26 2022] DELETE /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments/89853a1e-fe2e-4ef7-a2ef-a43fb46c7913 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:01:26.282859 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:26.285094 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:26.287290 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:26.287941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:26.294623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:26.295192 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:26.295681 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:26.296382 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:26.296838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:26.297303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:26.329233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-27eb5924-f578-4189-b50f-74a9a24c69dc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050557 Aug 09 18:01:26.330101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 313/605] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:26 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:27.343255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:27.345511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:27.351902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:27.352531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:27.353202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:27.353915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:27.354410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:27.354838 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:27.387573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1a0e07cd-7ffc-44d9-8b55-ac19672fc2ed tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049030 Aug 09 18:01:27.388132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 293/606] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:27 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:28.122039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:28.124581 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:28.131457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.132064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.132498 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.133180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.133633 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.134053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.161789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-10467aeb-0c3a-46ce-84a6-f049fcf7420e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043853 Aug 09 18:01:28.162338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 314/607] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:28 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:01:28.223408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:28.223846 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:28.230398 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.230881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.231378 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.232069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.232527 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.232954 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.258085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:01:28.334448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-21b45205-9993-4f1b-ae8e-30f0a994af60 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 204 len: 0 microversion: 2.1 time: 0.114760 Aug 09 18:01:28.339385 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 294/608] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:01:28 2022] DELETE /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:01:28.345482 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:28.346379 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:28.352652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.353127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.353558 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.354243 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.354688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.355317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.377611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:28.378277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:28.384258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.384739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.385175 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.385855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.386302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.386718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.411723 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cf5fd589-eaa5-4114-bdf1-b2c15b4884db tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/ips" status: 200 len: 148 microversion: 2.1 time: 0.103568 Aug 09 18:01:28.412283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 315/609] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 18:01:28 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/ips => generated 148 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:01:28.417352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:28.419819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:28.426019 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.426484 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.426908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.427622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.428252 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.428701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.461522 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d3df619f-480c-4f66-9bcd-ef174daee342 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048198 Aug 09 18:01:28.462103 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 316/610] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:28 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:01:28.501273 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:28.510013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-335f9cfd-3ac7-4352-8732-8608f8919728 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.168938 Aug 09 18:01:28.510995 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 295/611] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:28 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:28.541122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:28.541614 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:28.547514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.547987 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.548414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.549090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.549566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.549985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.575762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:01:28.662321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9b794c7c-1f94-41eb-a7b0-e12bd9dd36ff tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "DELETE /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 204 len: 0 microversion: 2.1 time: 0.124958 Aug 09 18:01:28.664437 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 317/612] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:01:28 2022] DELETE /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:01:28.673264 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:28.673883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:28.680678 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.681245 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.681684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.682383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:28.682837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:28.683300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:28.816306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:28.824490 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-78732a73-c2ff-4266-bbf9-7337a962d066 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.155068 Aug 09 18:01:28.825056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 296/613] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:28 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:29.532710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:29.533413 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:29.539328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:29.539808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:29.540246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:29.540929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:29.541381 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:29.541800 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:29.669717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:29.677116 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eff14788-a5fb-4555-95fc-15f4bf1878c0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.148714 Aug 09 18:01:29.677712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 318/614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:29 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:29.788083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f89a37c5-bcd5-4a8e-9f84-f644c317d9a8"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:29.790362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:29.796730 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:29.797215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:29.797652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:29.798345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:29.798796 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:29.799246 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:29.847914 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:29.848330 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:29.854171 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:29.854653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:29.855116 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:29.855799 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:29.856245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:29.856661 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:29.988837 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:29.997178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93a76be9-0e00-43ee-9fe1-4eaf7fe03b78 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.153241 Aug 09 18:01:29.997738 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 319/615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:29 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:30.698406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:30.699114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:30.705177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:30.705657 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:30.706089 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:30.706774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:30.707254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:30.707677 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:30.834278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:30.845464 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a2e812ff-721f-4917-9ef9-fdcf88ac574f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.150831 Aug 09 18:01:30.846045 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 320/616] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:30 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:31.018755 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:31.019332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:31.025944 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:31.026427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:31.026912 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:31.027620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:31.028070 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:31.028493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:31.160577 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:31.171251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aae7e0dc-3fb5-4c7d-9b3f-c9bdced39aca tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.155897 Aug 09 18:01:31.172300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 321/617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:31 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:31.868107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:31.868748 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:31.874589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:31.875139 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:31.875827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:31.876506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:31.876952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:31.877368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:32.003466 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:32.010851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fccad1b-64d6-4bc0-a752-336aa9c1572e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.147294 Aug 09 18:01:32.011460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 322/618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:31 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:32.193352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:32.193889 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:32.199991 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:32.200475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:32.200911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:32.201611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:32.202048 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:32.202468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:32.331512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:32.339525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e4a514c2-1fba-4337-bb30-54d38f9e7675 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.150193 Aug 09 18:01:32.340088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 323/619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:32 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:33.032452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:33.033074 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:33.039232 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:33.039830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:33.040268 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:33.040971 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:33.041428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:33.041854 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:33.170784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:33.178236 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e786474b-d6b7-47f9-8ddd-c1fd23d02b37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.149653 Aug 09 18:01:33.178847 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 324/620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:33 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:33.361119 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:33.361736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:33.368359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:33.368839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:33.369269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:33.369955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:33.370406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:33.370832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:33.499275 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:33.506853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6d3a2d45-081c-457b-a53d-fecdd3a73470 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.149606 Aug 09 18:01:33.507519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 325/621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:33 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:34.200547 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:34.201181 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:34.207156 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:34.207633 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:34.208065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:34.208745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:34.209194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:34.209615 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:34.340797 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:34.348247 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-084e3241-078c-473b-aed9-b22b86b9c9e9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.151541 Aug 09 18:01:34.348814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 326/622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:34 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:34.527571 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:34.528190 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:34.534106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:34.534589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:34.535048 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:34.535742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:34.536195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:34.536619 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:34.666947 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:34.674366 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e5a59f86-27ed-4bf8-aa7a-89d25b4c436d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.150620 Aug 09 18:01:34.674934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 327/623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:34 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:35.369610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:35.370264 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:35.378766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:35.379667 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:35.380113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:35.380827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:35.381278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:35.381701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:35.386675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:35.515505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:35.523545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3b42eb0c-b122-4222-b59d-7a697cc38f92 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.157164 Aug 09 18:01:35.524116 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 328/624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:35 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:35.695946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:35.696475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:35.702329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:35.702805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:35.703277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:35.703984 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:35.704439 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:35.704858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:35.835855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:35.843268 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-60879548-ef2d-4016-a226-46c05127255d tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.151167 Aug 09 18:01:35.843833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 329/625] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:35 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:36.510202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-64fdbee1-47b3-4b9c-8e98-4fdbf943e0a4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.726002 Aug 09 18:01:36.510811 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 297/626] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:01:29 2022] POST /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments => generated 194 bytes in 6727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:36.544591 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:36.545383 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:36.551343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:36.551828 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:36.552264 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:36.553095 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:36.553392 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:36.554319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:36.685953 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:36.693299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e7fcde10-9c16-455d-be4f-cd8eb1b39015 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1674 microversion: 2.1 time: 0.152653 Aug 09 18:01:36.693856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 330/627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:36 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:36.865503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:36.866147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:36.873760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:36.874249 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:36.874796 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:36.875780 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:36.876234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:36.876657 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:37.129355 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:37.137355 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5d45ffe-de1d-46cf-a054-196600004afe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1689 microversion: 2.1 time: 0.276446 Aug 09 18:01:37.137961 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 298/628] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:36 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1689 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:37.715519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:37.719093 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:37.729302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:37.732025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:37.734384 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:37.737456 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:37.739789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:37.740421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:37.744767 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-a7ad3cf6-2531-4612-b353-706f7fc0d9b3 req-5352f7f6-584f-42a1-8871-07386877718c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc776d4-095b-4bbc-89a9-b99528a089f3", "name": "network-vif-deleted", "tag": "ccbb0e01-18a7-497b-830d-11366e7d9e61"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:37.760332 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a7ad3cf6-2531-4612-b353-706f7fc0d9b3 req-5352f7f6-584f-42a1-8871-07386877718c service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:37.761442 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a7ad3cf6-2531-4612-b353-706f7fc0d9b3 req-5352f7f6-584f-42a1-8871-07386877718c service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:37.762139 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a7ad3cf6-2531-4612-b353-706f7fc0d9b3 req-5352f7f6-584f-42a1-8871-07386877718c service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:37.790524 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-a7ad3cf6-2531-4612-b353-706f7fc0d9b3 req-5352f7f6-584f-42a1-8871-07386877718c service nova] Creating event network-vif-deleted:ccbb0e01-18a7-497b-830d-11366e7d9e61 for instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 on hv-cinder-83608 Aug 09 18:01:37.816684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-a7ad3cf6-2531-4612-b353-706f7fc0d9b3 req-5352f7f6-584f-42a1-8871-07386877718c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079306 Aug 09 18:01:37.821313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 299/629] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:01:37.836546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-0d0685cc-9d76-4698-904c-ed8c42ce2b63 req-877c2a14-5c4d-4ec9-b41b-ef55e8572ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b85a38-edb0-4b79-aacd-a37285510d9d", "name": "network-vif-deleted", "tag": "6a6de140-539e-4abe-b62f-b0a3cb0ddffc"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:37.868535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0d0685cc-9d76-4698-904c-ed8c42ce2b63 req-877c2a14-5c4d-4ec9-b41b-ef55e8572ac1 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:37.870600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0d0685cc-9d76-4698-904c-ed8c42ce2b63 req-877c2a14-5c4d-4ec9-b41b-ef55e8572ac1 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:37.872238 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0d0685cc-9d76-4698-904c-ed8c42ce2b63 req-877c2a14-5c4d-4ec9-b41b-ef55e8572ac1 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:37.882996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:37.892455 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-0d0685cc-9d76-4698-904c-ed8c42ce2b63 req-877c2a14-5c4d-4ec9-b41b-ef55e8572ac1 service nova] Creating event network-vif-deleted:6a6de140-539e-4abe-b62f-b0a3cb0ddffc for instance 96b85a38-edb0-4b79-aacd-a37285510d9d on hv-cinder-83608 Aug 09 18:01:37.894155 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-95052877-7e35-4532-a676-b4cb62e0ad91 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1606 microversion: 2.1 time: 0.182472 Aug 09 18:01:37.895301 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 331/630] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:37 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1606 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:37.911336 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-0d0685cc-9d76-4698-904c-ed8c42ce2b63 req-877c2a14-5c4d-4ec9-b41b-ef55e8572ac1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087915 Aug 09 18:01:37.912007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 300/631] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:38.157807 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:38.158414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:38.164256 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:38.164730 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:38.165159 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:38.166016 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:38.166460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:38.166870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:38.198441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:38.198911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:38.199535 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:38.200161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'fault' on Instance uuid 96b85a38-edb0-4b79-aacd-a37285510d9d {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:38.243697 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:38.252453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ff70ba43-00e2-4ca2-85d1-42678088bd74 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 200 len: 1334 microversion: 2.1 time: 0.098443 Aug 09 18:01:38.259156 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 332/632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:38 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:38.926376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:38.927116 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:38.934111 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:38.934608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:38.935073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:38.935777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:38.943095 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:38.943552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:38.981643 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:38.982107 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:38.982540 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:38.983202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lazy-loading 'fault' on Instance uuid 6fc776d4-095b-4bbc-89a9-b99528a089f3 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:39.032293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:39.040812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c1f4d92d-6a74-4907-bab1-7a519bcae57b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 200 len: 1327 microversion: 2.1 time: 0.125777 Aug 09 18:01:39.041668 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 301/633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:38 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:39.274324 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:39.274937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 96b85a38-edb0-4b79-aacd-a37285510d9d] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:39.280937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:39.281417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:39.281856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:39.282569 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:39.283052 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:39.283480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:39.296795 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] HTTP exception thrown: Instance 96b85a38-edb0-4b79-aacd-a37285510d9d could not be found. Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Request method failure captured: Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d HTTP/1.1 Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_ENkpffXr2zSFxwPtM5XL1o7MLekOa5K8bYYPQiqjiHWveoX5QSNnPRZM-hoZhfIhsubxQJlulV7XFSpcLhF3owFmm14AcXqnzKD5Pu7E5WhY405oX6swzCqnqYPjAUYa9hAj1eoZohAVi8k209pGy_OpP64jT8E9usg9v29Jd6N4 Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:01:39.298401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13cf0de2979c44a08f500430834617d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13cf0de2979c44a08f500430834617d2", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: f7491479bd88425f8234e0b1d0e11e55 Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 96b85a38-edb0-4b79-aacd-a37285510d9d could not be found. Aug 09 18:01:39.299895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '96b85a38-edb0-4b79-aacd-a37285510d9d'} Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b85a38-edb0-4b79-aacd-a37285510d9d could not be found. Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:01:39.300617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b85a38-edb0-4b79-aacd-a37285510d9d could not be found. Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b85a38-edb0-4b79-aacd-a37285510d9d could not be found. Aug 09 18:01:39.301985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:39.303300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Returning 404 to user: Instance 96b85a38-edb0-4b79-aacd-a37285510d9d could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:01:39.303300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7d158537-b794-4d68-ba23-192ea6d7b401 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d" status: 404 len: 111 microversion: 2.1 time: 0.030162 Aug 09 18:01:39.303300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 333/634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:39 2022] GET /compute/v2.1/servers/96b85a38-edb0-4b79-aacd-a37285510d9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:01:39.308631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a1bce3d-3ad0-46e2-ad54-af091e8fdb05 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '.version_select at 0x7f8c069225e0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:39.327552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a1bce3d-3ad0-46e2-ad54-af091e8fdb05 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-330771617" status: 202 len: 0 microversion: 2.1 time: 0.022666 Aug 09 18:01:39.328129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 302/635] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 9 18:01:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-330771617 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:01:40.061665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:40.062274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:40.068436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:40.068913 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:40.069345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:40.070035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:40.070729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:40.071520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:40.084857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] HTTP exception thrown: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Request method failure captured: Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 HTTP/1.1 Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p--1aZBoRGQoD7CLYvQHdVFpy5xtEspE6DtCjLsHoeEqSfW3ostQg76NkmL74CZ6lKQXRkoAk7zTjm69p5yUUfLK5wB1OaazwVv-nBrb-F5aE7SOFVgiG37wTR0JGZ6uBR76j2-En2Du4NaHrGEj4kJ3Eg_DFelX2Z5j0mNZj1jxnM Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:01:40.086356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6816355a42d64d5988aff83532ff5888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6816355a42d64d5988aff83532ff5888", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: cb11c04acb4f40cd9d09edf16b11abb0 Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:01:40.087925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '6fc776d4-095b-4bbc-89a9-b99528a089f3'} Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:01:40.088834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:01:40.090222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:40.091486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Returning 404 to user: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:01:40.091486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4528f33e-e63a-46d5-8184-1df9c32fa5d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 404 len: 111 microversion: 2.1 time: 0.029949 Aug 09 18:01:40.091486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 334/636] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:40 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:01:40.097208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9031cada-8787-455c-9ed6-359b06629e05 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '.version_select at 0x7f8c06770ca0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:40.117788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9031cada-8787-455c-9ed6-359b06629e05 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071726028" status: 202 len: 0 microversion: 2.1 time: 0.024885 Aug 09 18:01:40.118367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 303/637] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 9 18:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071726028 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:01:40.767394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3bba47cc-8f72-428b-825b-2cd8e136b608 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'create', calling method: .version_select at 0x7f8c06a25c10>, body: {"keypair": {"name": "tempest-keypair-994094190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLld8faVRvhRFf1DUrmA0FEqVd92eHq2KHFs97UK/ZY64rIIjKwE5q8+OTDfe1lMsU8n8+pM44MouDLUhzAFfvzoM0TWM1sIpJHsRe7vUv04dIatduZ7NHiH2rXA+KQUEA=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:40.783542 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-3bba47cc-8f72-428b-825b-2cd8e136b608 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for project 6816355a42d64d5988aff83532ff5888. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:01:40.787362 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-3bba47cc-8f72-428b-825b-2cd8e136b608 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for user cb11c04acb4f40cd9d09edf16b11abb0 and project 6816355a42d64d5988aff83532ff5888. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:01:40.818372 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3bba47cc-8f72-428b-825b-2cd8e136b608 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055264 Aug 09 18:01:40.819864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 335/638] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 18:01:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:42.118165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-867452379", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89185f52-f4e7-40d3-aaf9-79262f0a24c9"}], "security_groups": [{"name": "tempest-securitygroup--726411477"}], "key_name": "tempest-keypair-994094190", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:42.220116 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:42.220622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:42.223541 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] validate_networks() for [('89185f52-f4e7-40d3-aaf9-79262f0a24c9', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:01:42.227104 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:42.227593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:42.228030 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:42.228721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:42.229173 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:42.229714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:42.255556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:01:42.335554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ee29b098-15eb-4d9c-bf5d-a3b471e68138 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 204 len: 0 microversion: 2.1 time: 0.118806 Aug 09 18:01:42.336676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 336/639] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:01:42 2022] DELETE /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:01:42.345356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:42.346678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:42.353279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:42.353827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:42.354175 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:42.354865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:42.355372 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:42.355786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:42.556772 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:42.564729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e76631fc-0f58-4a1d-bfd8-788ddecca395 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1509 microversion: 2.1 time: 0.223940 Aug 09 18:01:42.565538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 337/640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:42 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:42.910119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:01:42.910544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:01:42.911110 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:01:42.911851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:01:42.912265 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:01:42.924395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:42.924881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:42.925315 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:42.926038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:42.926663 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:42.927132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:42.943461 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for project 6816355a42d64d5988aff83532ff5888. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:01:42.948026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Getting quotas for user cb11c04acb4f40cd9d09edf16b11abb0 and project 6816355a42d64d5988aff83532ff5888. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:01:42.959504 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:01:42.962467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:01:43.006163 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0981d532-aeea-4856-ae89-3caf1a7eddb0 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.893107 Aug 09 18:01:43.007348 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 304/641] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:01:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:01:43.018036 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3565c0ee-9b2c-4918-a9e0-7872868c2b97 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:43.018678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3565c0ee-9b2c-4918-a9e0-7872868c2b97 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:43.074512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3565c0ee-9b2c-4918-a9e0-7872868c2b97 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:43.081091 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3565c0ee-9b2c-4918-a9e0-7872868c2b97 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1236 microversion: 2.1 time: 0.066933 Aug 09 18:01:43.081649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 338/642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:43 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:43.586922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:43.587560 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:43.594206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:43.594692 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:43.595172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:43.595869 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:43.596324 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:43.596751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:43.726556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:43.733944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5164c260-6df8-4c18-ac7a-4c49e86a78bc tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1509 microversion: 2.1 time: 0.151950 Aug 09 18:01:43.734505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 305/643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:43 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:44.101700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:44.102343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:44.108360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:44.108906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:44.109336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:44.110023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:44.110473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:44.110895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:44.172104 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:44.179421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-98be2ef9-654a-468e-a804-9db4d46fd0f1 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1240 microversion: 2.1 time: 0.081590 Aug 09 18:01:44.180498 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 339/644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:44 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:44.754862 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:44.755503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:44.762189 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:44.762673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:44.763150 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:44.763851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:44.764304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:44.764733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:44.903529 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:44.911171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-88a4698c-72a2-41bd-8310-f6db3287e41e tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1509 microversion: 2.1 time: 0.160448 Aug 09 18:01:44.911753 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 306/645] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:44 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:45.200511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:45.201118 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:45.207028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:45.207511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:45.207944 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:45.208625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:45.209075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:45.209492 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:45.269983 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:45.277551 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ebb7a7b-b796-48b8-9672-09f44bf60c8f tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1232 microversion: 2.1 time: 0.080901 Aug 09 18:01:45.278129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 340/646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:45 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1232 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:45.935323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:45.935937 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:45.942695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:45.943215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:45.943649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:45.944345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:45.944796 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:45.945210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:46.099577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:46.107591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-31872447-1ec2-4308-ae07-e0bf23ea21fe tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 200 len: 1509 microversion: 2.1 time: 0.176163 Aug 09 18:01:46.108457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 307/647] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:45 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:46.301810 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:46.304086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:46.312779 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:46.313551 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:46.314130 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:46.315741 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:46.316403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:46.316979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:46.346710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:46.396014 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6172981b-0c67-46cc-afc3-dda4f8bbe964 req-85b01582-9c82-4ecc-9442-3e182fcd12b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa4777f-70e1-491f-9595-5e72966cddb9", "name": "network-vif-deleted", "tag": "664a7e59-c2d6-45f3-bd6d-0efea18ceb4f"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:46.408932 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6172981b-0c67-46cc-afc3-dda4f8bbe964 req-85b01582-9c82-4ecc-9442-3e182fcd12b7 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:46.409867 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6172981b-0c67-46cc-afc3-dda4f8bbe964 req-85b01582-9c82-4ecc-9442-3e182fcd12b7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:46.410485 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6172981b-0c67-46cc-afc3-dda4f8bbe964 req-85b01582-9c82-4ecc-9442-3e182fcd12b7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:46.424646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6172981b-0c67-46cc-afc3-dda4f8bbe964 req-85b01582-9c82-4ecc-9442-3e182fcd12b7 service nova] Creating event network-vif-deleted:664a7e59-c2d6-45f3-bd6d-0efea18ceb4f for instance 9fa4777f-70e1-491f-9595-5e72966cddb9 on hv-cinder-83608 Aug 09 18:01:46.432669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6172981b-0c67-46cc-afc3-dda4f8bbe964 req-85b01582-9c82-4ecc-9442-3e182fcd12b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143082 Aug 09 18:01:46.433402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 341/648] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:46.449670 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:46.458606 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b7d1f9b5-7e7f-4b8b-bea2-de04004ac149 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1306 microversion: 2.1 time: 0.161853 Aug 09 18:01:46.459372 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 308/649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:46 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1306 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:47.130011 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:47.130558 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: 9fa4777f-70e1-491f-9595-5e72966cddb9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:47.137384 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.138044 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.138634 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.140280 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.141068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.141635 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.158423 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] HTTP exception thrown: Instance 9fa4777f-70e1-491f-9595-5e72966cddb9 could not be found. Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Request method failure captured: Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 HTTP/1.1 Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_ENkpffXr2zSFxwPtM5XL1o7MLekOa5K8bYYPQiqjiHWveoX5QSNnPRZM-hoZhfIhsubxQJlulV7XFSpcLhF3owFmm14AcXqnzKD5Pu7E5WhY405oX6swzCqnqYPjAUYa9hAj1eoZohAVi8k209pGy_OpP64jT8E9usg9v29Jd6N4 Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:01:47.160274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13cf0de2979c44a08f500430834617d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13cf0de2979c44a08f500430834617d2", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: f7491479bd88425f8234e0b1d0e11e55 Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 9fa4777f-70e1-491f-9595-5e72966cddb9 could not be found. Aug 09 18:01:47.161773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '9fa4777f-70e1-491f-9595-5e72966cddb9'} Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa4777f-70e1-491f-9595-5e72966cddb9 could not be found. Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:01:47.162595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa4777f-70e1-491f-9595-5e72966cddb9 could not be found. Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa4777f-70e1-491f-9595-5e72966cddb9 could not be found. Aug 09 18:01:47.164839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.166907 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Returning 404 to user: Instance 9fa4777f-70e1-491f-9595-5e72966cddb9 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:01:47.168425 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b15572f8-f51a-45fd-ad12-54b71165db5a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9" status: 404 len: 111 microversion: 2.1 time: 0.043036 Aug 09 18:01:47.170956 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 342/650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:47 2022] GET /compute/v2.1/servers/9fa4777f-70e1-491f-9595-5e72966cddb9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:01:47.178293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:47.178850 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:47.185472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.185958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.186401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.187108 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.187553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.187974 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.214278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:01:47.299853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f89a37c5-bcd5-4a8e-9f84-f644c317d9a8"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:47.302776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:47.310126 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.310611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.311079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.311222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d062296-b15d-4869-ba7b-0f9fba26af7b tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 204 len: 0 microversion: 2.1 time: 0.135440 Aug 09 18:01:47.311785 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.312237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.312685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.313244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 309/651] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:01:47 2022] DELETE /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:01:47.323624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:47.324854 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:47.331722 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.332206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.332828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.333533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.334104 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.334532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.406622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Invalid volume: volume f89a37c5-bcd5-4a8e-9f84-f644c317d9a8 is already attached to instances: 583dd4cf-1ee5-4244-bec6-a9fc62f38403 Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments HTTP/1.1 Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 74 Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:01:47.408287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {"volumeAttachment": {"volumeId": "f89a37c5-bcd5-4a8e-9f84-f644c317d9a8"}} Aug 09 18:01:47.409763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Invalid volume: volume f89a37c5-bcd5-4a8e-9f84-f644c317d9a8 is already attached to instances: 583dd4cf-1ee5-4244-bec6-a9fc62f38403 Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'server_id': '583dd4cf-1ee5-4244-bec6-a9fc62f38403', 'body': {'volumeAttachment': {'volumeId': 'f89a37c5-bcd5-4a8e-9f84-f644c317d9a8'}}} Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f89a37c5-bcd5-4a8e-9f84-f644c317d9a8 is already attached to instances: 583dd4cf-1ee5-4244-bec6-a9fc62f38403 Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.410600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f89a37c5-bcd5-4a8e-9f84-f644c317d9a8 is already attached to instances: 583dd4cf-1ee5-4244-bec6-a9fc62f38403 Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:47.411739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:47.412919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:47.412919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:01:47.412919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:01:47.412919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f89a37c5-bcd5-4a8e-9f84-f644c317d9a8 is already attached to instances: 583dd4cf-1ee5-4244-bec6-a9fc62f38403 Aug 09 18:01:47.412919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:47.412919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 400 to user: Invalid volume: volume f89a37c5-bcd5-4a8e-9f84-f644c317d9a8 is already attached to instances: 583dd4cf-1ee5-4244-bec6-a9fc62f38403 {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:01:47.412919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b7bfdc3d-8a70-4a4f-9a08-f2622765dbb0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115945 Aug 09 18:01:47.413891 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 343/652] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:01:47 2022] POST /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:01:47.480930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:47.481632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:47.487775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.488340 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.488801 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.489490 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.489942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.490368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.587735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:47.595122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-488e42fd-e98a-44c4-8d8e-20125df794c3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.277451 Aug 09 18:01:47.595695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 310/653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:47 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:47.600253 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:47.600738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:47.606655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.607170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.607667 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.608356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.608805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.609219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.691694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lazy-loading 'services' on Instance uuid 583dd4cf-1ee5-4244-bec6-a9fc62f38403 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:47.721497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:47.729208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-96d0cc2b-6f4c-4530-87c3-6de3f51df455 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.252594 Aug 09 18:01:47.729874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 344/654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:47 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:47.772427 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dd4b6267-1394-45a0-8594-4d41435978c8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments/f89a37c5-bcd5-4a8e-9f84-f644c317d9a8" status: 202 len: 0 microversion: 2.1 time: 0.175534 Aug 09 18:01:47.773042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 311/655] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:01:47 2022] DELETE /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments/f89a37c5-bcd5-4a8e-9f84-f644c317d9a8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:01:47.781448 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:47.783605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:47.789506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.789983 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.790409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.791145 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.791594 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.792013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:47.822764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-720ee074-e878-41cf-8ee1-385255937fa6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Aug 09 18:01:47.823355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 345/656] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:47 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:47.981141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-85c5f51f-9d94-47ff-88c0-4788aa70c275 req-ba49b15f-3434-49e4-893b-04ed3221ea38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "033ec247-be83-408c-8635-e4cfe8a6212f", "tag": "37dfc28e-1441-459f-913c-19b30ae3957b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:47.992788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-85c5f51f-9d94-47ff-88c0-4788aa70c275 req-ba49b15f-3434-49e4-893b-04ed3221ea38 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:47.993373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-85c5f51f-9d94-47ff-88c0-4788aa70c275 req-ba49b15f-3434-49e4-893b-04ed3221ea38 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:47.993809 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-85c5f51f-9d94-47ff-88c0-4788aa70c275 req-ba49b15f-3434-49e4-893b-04ed3221ea38 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:48.004792 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-85c5f51f-9d94-47ff-88c0-4788aa70c275 req-ba49b15f-3434-49e4-893b-04ed3221ea38 service nova] Creating event network-changed:37dfc28e-1441-459f-913c-19b30ae3957b for instance 033ec247-be83-408c-8635-e4cfe8a6212f on hv-cinder-83608 Aug 09 18:01:48.010350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-85c5f51f-9d94-47ff-88c0-4788aa70c275 req-ba49b15f-3434-49e4-893b-04ed3221ea38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089464 Aug 09 18:01:48.010959 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 312/657] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:01:48.616396 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:48.617003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:48.623598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:48.624076 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:48.624504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:48.625210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:48.625914 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:48.626335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:48.752712 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:48.753540 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:48.760789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:48.762498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:48.762498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:48.762498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:48.763174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:48.763639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:48.764065 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:48.772673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6fc65479-b8dd-4a75-9e3f-ea2087a37e99 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.160174 Aug 09 18:01:48.773341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 346/658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:48 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:48.835251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:48.837592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:48.843538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:48.844021 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:48.844456 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:48.845147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:48.845595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:48.846017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:48.863730 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:48.879967 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d6404f3d-2cbe-45a4-9b6d-c50fb8f127ba tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048565 Aug 09 18:01:48.880469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 347/659] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:48 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:01:48.901933 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:48.910358 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-12e6be6e-e558-4369-b377-179f361a1a62 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.162642 Aug 09 18:01:48.910933 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 313/660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:48 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:49.793983 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:49.794592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:49.800801 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:49.801283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:49.801745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:49.802431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:49.802882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:49.803337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:49.891336 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:49.893557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:49.900714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:49.901201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:49.901642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:49.902342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:49.902798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:49.903251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:49.930442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:49.933821 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e84cc7d9-d01a-457c-b35f-fe0cf8ddac33 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Aug 09 18:01:49.934401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 314/661] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:49 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:01:49.937982 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4babbd30-3069-4ee5-9f6c-70940b2cb4b9 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.148417 Aug 09 18:01:49.938558 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 348/662] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:49 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:49.938944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:49.939636 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:49.945779 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:49.946563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:49.946713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:49.947406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:49.947860 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:49.948282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:50.078278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:50.085547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2e18a6a-5643-4ae6-b134-efacd07b9be9 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.150223 Aug 09 18:01:50.086108 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 315/663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:49 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:50.946016 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:50.949064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:50.952037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:50.956956 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:50.957567 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:50.957899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:50.958595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:50.959245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:50.959667 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:50.963195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:50.963906 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:50.971954 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:50.972793 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:50.973297 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:50.973991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:50.974599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:50.975211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:50.996272 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f4d1a322-844e-4ee5-843e-c39f550a2325 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054197 Aug 09 18:01:50.996845 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 349/664] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:50 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:51.106581 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:51.107223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:51.111979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:51.113218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:51.113705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:51.114139 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:51.114828 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:51.115307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:51.116052 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:51.120080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7108b953-bc1f-4e49-9406-5131ab7c43b3 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1522 microversion: 2.1 time: 0.164760 Aug 09 18:01:51.120930 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 316/665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:50 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:51.247228 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:51.255406 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d6048a34-bac2-4510-9678-ce08084538d3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.153540 Aug 09 18:01:51.256016 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 350/666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:51 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:51.931229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-93b21184-588d-4418-9446-b21e5815960c req-a147639c-b391-4eeb-8cc1-b188227071f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49d1e42-20f2-496b-bf4b-14348388eccb", "name": "network-vif-deleted", "tag": "37180717-0671-42b4-a508-b367fca29a06"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:51.941031 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-93b21184-588d-4418-9446-b21e5815960c req-a147639c-b391-4eeb-8cc1-b188227071f7 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:51.941516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-93b21184-588d-4418-9446-b21e5815960c req-a147639c-b391-4eeb-8cc1-b188227071f7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:51.942032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-93b21184-588d-4418-9446-b21e5815960c req-a147639c-b391-4eeb-8cc1-b188227071f7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:51.954258 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-93b21184-588d-4418-9446-b21e5815960c req-a147639c-b391-4eeb-8cc1-b188227071f7 service nova] Creating event network-vif-deleted:37180717-0671-42b4-a508-b367fca29a06 for instance c49d1e42-20f2-496b-bf4b-14348388eccb on hv-cinder-83608 Aug 09 18:01:51.959347 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-93b21184-588d-4418-9446-b21e5815960c req-a147639c-b391-4eeb-8cc1-b188227071f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031958 Aug 09 18:01:51.960082 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 317/667] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:52.009972 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:52.012744 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:52.019885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.020377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.020861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.021781 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.022245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.022655 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.054306 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-54a7f8e0-2bca-4d6b-9fd2-ca389a0f91ae tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048629 Aug 09 18:01:52.060129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 351/668] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:01:52 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:01:52.120277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:52.120865 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:52.127278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.127768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.128204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.128889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.129337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.129755 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.141619 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:52.143075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:52.154338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.154798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.155936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.156692 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.157824 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.158480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.168546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:01:52.195001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.196041 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.196478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.196921 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'fault' on Instance uuid c49d1e42-20f2-496b-bf4b-14348388eccb {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:52.244654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:52.251746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-17304d27-43d1-4442-bf62-152fbf62beaf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 204 len: 0 microversion: 2.1 time: 0.135940 Aug 09 18:01:52.252339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 318/669] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:01:52 2022] DELETE /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:01:52.255188 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-053bbeda-84ae-400c-9d7f-a8391419a142 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1312 microversion: 2.1 time: 0.114902 Aug 09 18:01:52.255188 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 352/670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:52 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:52.261616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:52.262309 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:52.268570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.269255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.269867 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.270728 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.271375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.271807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.276368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:52.277003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:52.282814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.283321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.283746 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.284435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:52.284878 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:52.285291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:52.483830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:52.487778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:52.491520 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6e4b19f3-5fc0-449c-a404-2193a9b8a3c6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1681 microversion: 2.1 time: 0.234690 Aug 09 18:01:52.492607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 319/671] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:52 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:52.496578 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-57750d0e-7819-46f3-baa0-9321341e5ffa tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.223079 Aug 09 18:01:52.496578 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 353/672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:52 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:53.274632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:53.275302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:53.277113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:53.282485 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:53.282963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:53.283431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:53.284116 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:53.284567 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:53.284988 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:53.314863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:53.315383 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:53.315818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:53.316259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'fault' on Instance uuid c49d1e42-20f2-496b-bf4b-14348388eccb {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:53.361960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:53.370001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4fe2f390-d0c5-4163-ae1b-3ed4eb59fd3a tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1312 microversion: 2.1 time: 0.099246 Aug 09 18:01:53.370559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 354/673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:53 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:53.514464 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:53.515102 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:53.517027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:53.517641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:53.517787 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:53.518080 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:53.523874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:53.524353 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:53.524503 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:53.524785 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:53.524886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:53.525259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:53.525465 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:53.525909 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:53.526006 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:53.526325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:53.526424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:53.526792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:53.718707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:53.722628 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:53.726159 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f447713-9792-46cf-b0ca-46fe2ce8754c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.212411 Aug 09 18:01:53.727527 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 355/674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:53 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:53.730986 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a85bcaab-2ce9-4c74-9eda-65dfb7d7a487 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1681 microversion: 2.1 time: 0.220265 Aug 09 18:01:53.731554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 320/675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:53 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:54.390857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:54.391528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:54.397431 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:54.397907 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:54.398340 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:54.399046 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:54.399502 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:54.399923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:54.429482 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:54.430586 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:54.431043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:54.431480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lazy-loading 'fault' on Instance uuid c49d1e42-20f2-496b-bf4b-14348388eccb {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:54.473813 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7491479bd88425f8234e0b1d0e11e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cf0de2979c44a08f500430834617d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:54.482045 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-da4e4a96-f859-4d93-82ef-62165fdb8f10 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 200 len: 1312 microversion: 2.1 time: 0.095091 Aug 09 18:01:54.482614 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 356/676] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:54 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:54.749010 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:54.749531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:54.752271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:54.752886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:54.753127 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:54.756957 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:54.757523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:54.758117 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:54.759126 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:54.759715 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:54.759854 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:54.760285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:54.760394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:54.760990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:54.761710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:54.762172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:54.762596 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:54.960820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:54.966434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:54.973382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ab5248cb-5ff1-41c8-9193-db92f902ebf5 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.228474 Aug 09 18:01:54.973963 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 321/677] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:54 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:54.982037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b0c98034-aa25-4eec-9628-75d4f6b9ee85 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1681 microversion: 2.1 time: 0.233814 Aug 09 18:01:54.983001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 357/678] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:54 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:01:55.502400 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:55.503038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] [instance: c49d1e42-20f2-496b-bf4b-14348388eccb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:55.508958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:55.509443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:55.509877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:55.510571 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:55.511044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:55.511476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:55.525217 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] HTTP exception thrown: Instance c49d1e42-20f2-496b-bf4b-14348388eccb could not be found. Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Request method failure captured: Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb HTTP/1.1 Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_ENkpffXr2zSFxwPtM5XL1o7MLekOa5K8bYYPQiqjiHWveoX5QSNnPRZM-hoZhfIhsubxQJlulV7XFSpcLhF3owFmm14AcXqnzKD5Pu7E5WhY405oX6swzCqnqYPjAUYa9hAj1eoZohAVi8k209pGy_OpP64jT8E9usg9v29Jd6N4 Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:01:55.526914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13cf0de2979c44a08f500430834617d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13cf0de2979c44a08f500430834617d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13cf0de2979c44a08f500430834617d2", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 13cf0de2979c44a08f500430834617d2 Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1552698637 Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: f7491479bd88425f8234e0b1d0e11e55 Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1552698637-project Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance c49d1e42-20f2-496b-bf4b-14348388eccb could not be found. Aug 09 18:01:55.528208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'c49d1e42-20f2-496b-bf4b-14348388eccb'} Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49d1e42-20f2-496b-bf4b-14348388eccb could not be found. Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:01:55.529019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49d1e42-20f2-496b-bf4b-14348388eccb could not be found. Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49d1e42-20f2-496b-bf4b-14348388eccb could not be found. Aug 09 18:01:55.530187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:01:55.531276 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] Returning 404 to user: Instance c49d1e42-20f2-496b-bf4b-14348388eccb could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:01:55.531276 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fd2ccdd3-095e-43d3-92ec-c428e8d359d8 tempest-ServerRescueNegativeTestJSON-1552698637 tempest-ServerRescueNegativeTestJSON-1552698637-project] 10.222.0.52 "GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb" status: 404 len: 111 microversion: 2.1 time: 0.030083 Aug 09 18:01:55.531276 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 322/679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:55 2022] GET /compute/v2.1/servers/c49d1e42-20f2-496b-bf4b-14348388eccb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:01:55.994505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:55.995868 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:56.005587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:56.006390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:56.007059 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:56.007609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:56.008946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:56.009358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:56.010005 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:56.010616 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:56.022498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:56.023470 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:56.024128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:56.025053 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:56.025872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:56.026693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:56.031466 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:56.238154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:56.246578 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4d5e3ea0-62fc-4196-8d2a-14541f9de890 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 200 len: 1613 microversion: 2.1 time: 0.246512 Aug 09 18:01:56.259002 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 323/680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:55 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 1613 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:56.319081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:56.319850 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:56.326790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:56.327534 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:56.328231 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:56.329080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:56.329706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:56.330267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:56.356508 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4224642c-5e57-4836-b495-4772f8613d86 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/ips" status: 200 len: 153 microversion: 2.20 time: 0.108283 Aug 09 18:01:56.359489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:56.368485 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-48b72f7a-a502-43ee-a728-969f48f77c31 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.378515 Aug 09 18:01:56.373689 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 324/681] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Aug 9 18:01:56 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/ips => generated 153 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:01:56.379776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 358/682] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:55 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:56.568464 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-28c62f1c-7745-4f35-a77e-0a578a66e9e1 req-985bf187-9f18-44b6-a3ab-131caec25796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583dd4cf-1ee5-4244-bec6-a9fc62f38403", "name": "network-vif-deleted", "tag": "f3051d76-2d8c-47bb-838a-d056bb6d6a21"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:56.588264 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-28c62f1c-7745-4f35-a77e-0a578a66e9e1 req-985bf187-9f18-44b6-a3ab-131caec25796 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:56.589143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-28c62f1c-7745-4f35-a77e-0a578a66e9e1 req-985bf187-9f18-44b6-a3ab-131caec25796 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:56.589737 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-28c62f1c-7745-4f35-a77e-0a578a66e9e1 req-985bf187-9f18-44b6-a3ab-131caec25796 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:56.606447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-28c62f1c-7745-4f35-a77e-0a578a66e9e1 req-985bf187-9f18-44b6-a3ab-131caec25796 service nova] Creating event network-vif-deleted:f3051d76-2d8c-47bb-838a-d056bb6d6a21 for instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 on hv-cinder-83608 Aug 09 18:01:56.613459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-28c62f1c-7745-4f35-a77e-0a578a66e9e1 req-985bf187-9f18-44b6-a3ab-131caec25796 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048708 Aug 09 18:01:56.615129 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 325/683] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:57.272167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:57.273982 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:57.280894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:57.281375 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:57.282001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:57.282870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:57.283496 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:57.284099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:57.299599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 HTTP/1.1 Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:01:57.301663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:01:57.303165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '583dd4cf-1ee5-4244-bec6-a9fc62f38403'} Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:01:57.304062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:01:57.305421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:01:57.308031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:01:57.309111 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a6ec9b4b-79ed-4fcb-a4f0-cd049cfd57bb tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 404 len: 111 microversion: 2.1 time: 0.041877 Aug 09 18:01:57.310339 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 359/684] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:57 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:01:57.321060 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-29b5bb4a-d710-491b-9883-c7adda73cad0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '.version_select at 0x7f8c0674d3a0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:57.354341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-29b5bb4a-d710-491b-9883-c7adda73cad0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1151043323" status: 202 len: 0 microversion: 2.1 time: 0.037231 Aug 09 18:01:57.355516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 326/685] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 9 18:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1151043323 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:01:57.407640 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:57.408549 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:57.419479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-1eb8d749-f461-4e94-b755-b1c9b4ddea28 req-d3157657-4377-4a47-9148-e6f813a91caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033ec247-be83-408c-8635-e4cfe8a6212f", "name": "network-vif-plugged", "status": "completed", "tag": "37dfc28e-1441-459f-913c-19b30ae3957b"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:57.419924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:57.425092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:57.425950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:57.426861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:57.427506 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:57.428118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:57.431012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-1eb8d749-f461-4e94-b755-b1c9b4ddea28 req-d3157657-4377-4a47-9148-e6f813a91caf service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:57.431848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-1eb8d749-f461-4e94-b755-b1c9b4ddea28 req-d3157657-4377-4a47-9148-e6f813a91caf service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:57.432736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-1eb8d749-f461-4e94-b755-b1c9b4ddea28 req-d3157657-4377-4a47-9148-e6f813a91caf service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:57.446936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-1eb8d749-f461-4e94-b755-b1c9b4ddea28 req-d3157657-4377-4a47-9148-e6f813a91caf service nova] Creating event network-vif-plugged:37dfc28e-1441-459f-913c-19b30ae3957b for instance 033ec247-be83-408c-8635-e4cfe8a6212f on hv-cinder-83608 Aug 09 18:01:57.456418 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-1eb8d749-f461-4e94-b755-b1c9b4ddea28 req-d3157657-4377-4a47-9148-e6f813a91caf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114243 Aug 09 18:01:57.457649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 360/686] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:01:57.713176 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:57.727698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b9d265e8-db4f-4cff-96b9-626ec6d6569e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.325705 Aug 09 18:01:57.735669 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 327/687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:57 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:58.340368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b76922c3-940c-4991-aefa-131337ba200e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: .version_select at 0x7f8c068ce430>, body: {"keypair": {"name": "tempest-keypair-747073330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGX/Xn4q4l/2Q2COHWFTKTvHAzrGfj4vcTbx5CCCX3jO6SXamBLCk7/v4HGZALyXiG0/XP8ULWBsZYd/7RjkFENH89z3ohzrTmwqzZNh7ZuvoBvr9khhq1c03o53Kefhg=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:58.356369 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b76922c3-940c-4991-aefa-131337ba200e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:01:58.360367 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b76922c3-940c-4991-aefa-131337ba200e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:01:58.382505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b76922c3-940c-4991-aefa-131337ba200e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049095 Aug 09 18:01:58.383407 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 361/688] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 18:01:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:58.749074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:58.749786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:58.756700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:58.757192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:58.758457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:58.759089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:58.759630 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:58.760145 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:58.907543 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:58.916510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-942c3026-d2ee-4e3d-8769-6a9fa332412b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1361 microversion: 2.1 time: 0.171196 Aug 09 18:01:58.917092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 328/689] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:58 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:59.098288 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:59.101138 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:59.116255 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:59.121303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:59.123183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:59.124114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:59.124750 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:59.126478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:59.153000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lazy-loading 'flavor' on Instance uuid ff6e12fe-4b50-43ad-a12e-49a0575a710a {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:01:59.417355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6059f75f-0ccb-43da-8c60-a7a751c29168 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/action" status: 202 len: 0 microversion: 2.20 time: 0.327140 Aug 09 18:01:59.422371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 362/690] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 9 18:01:59 2022] POST /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:01:59.429944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:59.430569 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:59.437335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:59.437832 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:59.438270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:59.439034 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:59.439544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:59.440128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:59.709022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:59.720059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:59.721805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:59.723292 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-640815b8-e36c-4a1c-84f7-23073d631a42 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.297818 Aug 09 18:01:59.724551 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 329/691] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:01:59 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:01:59.939886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:59.940885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:59.948127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:59.948737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:59.949242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:59.950178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:59.950709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:59.951225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:59.970821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:00.107532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1853233650", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f6bff3-89eb-4947-b35c-63d3a99a9190"}], "security_groups": [{"name": "tempest-securitygroup--1503479326"}], "key_name": "tempest-keypair-747073330", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:00.148388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:00.156499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-55d7b751-85e5-4976-9e0d-3e98443f21ab tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1546 microversion: 2.1 time: 0.222644 Aug 09 18:02:00.157173 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 363/692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:59 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:00.180454 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:00.180951 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:00.187071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:00.187567 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:00.188004 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:00.188838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:00.189342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:00.189765 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:00.233491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] validate_networks() for [('88f6bff3-89eb-4947-b35c-63d3a99a9190', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:02:00.336889 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e7567305-361f-4f9a-bf30-e37540f6b913 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163140 Aug 09 18:02:00.337488 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 364/693] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 18:02:00 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:02:00.682931 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:02:00.683711 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:02:00.684182 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:02:00.684589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:02:00.684992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:02:00.696125 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:00.696979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:00.697632 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:00.698425 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:00.698989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:00.699446 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:00.719011 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:02:00.723391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Getting quotas for user 478a0e3ac431440582d3dca1fe246ac3 and project f9182ab0c79d4b8a9de4c319491ca316. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:02:00.738058 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:02:00.741322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:02:00.752647 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:00.753259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:00.761888 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:00.762890 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:00.763820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:00.765473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:00.766242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:00.767037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:00.809554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f22ff406-3596-4ca2-b10d-ccf320c87597 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.706276 Aug 09 18:02:00.810759 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 330/694] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:02:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:02:00.823871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f3d3854f-1922-471e-b044-37d949235f4a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:00.824751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f3d3854f-1922-471e-b044-37d949235f4a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:00.931128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f3d3854f-1922-471e-b044-37d949235f4a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:00.944026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f3d3854f-1922-471e-b044-37d949235f4a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1241 microversion: 2.1 time: 0.126456 Aug 09 18:02:00.948092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 331/695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:00 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:00.963515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:00.973164 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:00.974833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:00.976511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de4d16ff-65eb-4f8d-a925-2ec99977e196 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.227834 Aug 09 18:02:00.977087 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 365/696] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:00 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:01.663337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-cf31ff14-f4fb-46f3-8681-99fbe4fef85c req-07a1ef32-2458-47a3-bb1f-5cbc2f7453c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "033ec247-be83-408c-8635-e4cfe8a6212f", "tag": "37dfc28e-1441-459f-913c-19b30ae3957b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:01.673611 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-cf31ff14-f4fb-46f3-8681-99fbe4fef85c req-07a1ef32-2458-47a3-bb1f-5cbc2f7453c8 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:01.674180 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-cf31ff14-f4fb-46f3-8681-99fbe4fef85c req-07a1ef32-2458-47a3-bb1f-5cbc2f7453c8 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:01.682097 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-cf31ff14-f4fb-46f3-8681-99fbe4fef85c req-07a1ef32-2458-47a3-bb1f-5cbc2f7453c8 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:01.694143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-cf31ff14-f4fb-46f3-8681-99fbe4fef85c req-07a1ef32-2458-47a3-bb1f-5cbc2f7453c8 service nova] Creating event network-changed:37dfc28e-1441-459f-913c-19b30ae3957b for instance 033ec247-be83-408c-8635-e4cfe8a6212f on hv-cinder-83608 Aug 09 18:02:01.699874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-cf31ff14-f4fb-46f3-8681-99fbe4fef85c req-07a1ef32-2458-47a3-bb1f-5cbc2f7453c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041206 Aug 09 18:02:01.700481 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 332/697] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:02:01.965779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:01.967123 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:01.976327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:01.976826 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:01.977846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:01.978652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:01.979237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:01.979887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:02.001875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:02.003378 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:02.035321 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:02.036046 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:02.037790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:02.042050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:02.042534 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:02.046935 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:02.212794 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:02.229670 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-81c48c47-79de-46c1-9ab5-55027e7253ef tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1311 microversion: 2.1 time: 0.269673 Aug 09 18:02:02.232507 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 366/698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:01 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1311 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:02.357477 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:02.368450 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:02.370251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:02.371911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c8ec456-6080-49c9-80bf-702cd8c27b8e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.374640 Aug 09 18:02:02.373153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 333/699] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:01 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:03.253987 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:03.254531 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:03.261038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:03.261526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:03.261964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:03.262665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:03.263150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:03.263578 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:03.402764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:03.404179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:03.410624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:03.414289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:03.421914 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7e9424b0-2ad5-4df2-aa66-45f787f47349 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.172093 Aug 09 18:02:03.422419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:03.422955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:03.423883 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 367/700] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:03 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:03.424556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:03.425093 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:03.425583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:03.580363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:03.589745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:03.591251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:03.592601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a7e3234d-12f0-4f5d-ab20-35f67249399f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.196217 Aug 09 18:02:03.593375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 334/701] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:03 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:03.741553 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-857b0025-33fd-46d5-9281-39c4831f22ea req-ec9643ef-9505-447c-bb58-34f414bc757b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abe122c-65b3-43db-aa85-c02ee6a4e1c1", "tag": "f4908d48-3b99-4092-8fc3-50909a3e1b00"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:03.761523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-857b0025-33fd-46d5-9281-39c4831f22ea req-ec9643ef-9505-447c-bb58-34f414bc757b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:03.762481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-857b0025-33fd-46d5-9281-39c4831f22ea req-ec9643ef-9505-447c-bb58-34f414bc757b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:03.763677 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-857b0025-33fd-46d5-9281-39c4831f22ea req-ec9643ef-9505-447c-bb58-34f414bc757b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:03.777916 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-857b0025-33fd-46d5-9281-39c4831f22ea req-ec9643ef-9505-447c-bb58-34f414bc757b service nova] Creating event network-changed:f4908d48-3b99-4092-8fc3-50909a3e1b00 for instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 on hv-cinder-83608 Aug 09 18:02:03.783316 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-857b0025-33fd-46d5-9281-39c4831f22ea req-ec9643ef-9505-447c-bb58-34f414bc757b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048403 Aug 09 18:02:03.784394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 368/702] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:02:04.444022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:04.444636 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:04.451688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:04.452176 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:04.452616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:04.453310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:04.453770 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:04.454198 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:04.581987 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:04.589314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ea3457ac-f923-422b-ab89-834386968fab tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.149143 Aug 09 18:02:04.589877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 335/703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:04 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:04.616478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:04.617798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:04.624162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:04.624648 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:04.625084 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:04.626028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:04.626481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:04.626903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:04.756575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:04.766641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:04.768165 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:04.769346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7949d581-96ad-42be-abd3-2fd4e625df67 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.157127 Aug 09 18:02:04.769925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 369/704] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:04 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:05.609755 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:05.610367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:05.616746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:05.617301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:05.617729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:05.618407 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:05.618851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:05.619300 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:05.748567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:05.756206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-aeda1814-9621-460b-8b72-1fb9bc5459a8 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.150251 Aug 09 18:02:05.756782 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 336/705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:05 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:05.792280 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:05.792887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:05.799871 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:05.800349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:05.800784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:05.801466 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:05.801951 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:05.802376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:05.929830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:05.937608 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:05.939219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:05.940363 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1cb18a5b-76d0-4de3-96bb-8fc07554b298 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.152057 Aug 09 18:02:05.940917 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 370/706] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:05 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:06.779442 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:06.780095 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:06.786616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:06.787133 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:06.787570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:06.788256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:06.789413 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:06.789792 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:06.922231 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:06.929934 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f2ed296e-fe7f-4266-ba06-89d30bc701ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.154416 Aug 09 18:02:06.930503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 337/707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:06 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:06.964210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:06.964819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:06.970722 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:06.971243 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:06.971673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:06.972368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:06.972819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:06.973241 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:07.105471 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:07.114863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:07.116465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:07.118245 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-396b90c1-09e0-44bf-9dca-d5c3b88ae22e tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.157934 Aug 09 18:02:07.118827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 371/708] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:06 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:07.950167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:07.950789 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:07.957474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:07.957965 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:07.958405 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:07.959140 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:07.959594 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:07.960017 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:08.097381 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:08.106172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-40a4d48f-ca85-4dcf-b0b5-fa2d364b3aaa tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.159855 Aug 09 18:02:08.106768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 338/709] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:07 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:08.141820 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:08.142603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:08.149109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:08.149792 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:08.150523 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:08.151592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:08.154632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:08.155087 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:08.294212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:08.301991 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:08.303519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:08.304811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9511e911-fc8a-4e84-9cb8-fb3a94de995d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.166952 Aug 09 18:02:08.305378 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 372/710] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:08 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:09.128109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:09.128715 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:09.135716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:09.135864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:09.136308 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:09.137012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:09.137472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:09.137899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:09.283241 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:09.290900 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fd634dcc-3556-44e7-8718-bf0a383708f2 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.167258 Aug 09 18:02:09.291735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 339/711] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:09 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:09.314370 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-2c4f1492-e1b2-4b50-b379-060347b88c6f req-7f9eacc6-032e-4696-bc08-145c43913221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abe122c-65b3-43db-aa85-c02ee6a4e1c1", "name": "network-vif-plugged", "status": "completed", "tag": "f4908d48-3b99-4092-8fc3-50909a3e1b00"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:09.319656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:09.329368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2c4f1492-e1b2-4b50-b379-060347b88c6f req-7f9eacc6-032e-4696-bc08-145c43913221 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:09.329856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2c4f1492-e1b2-4b50-b379-060347b88c6f req-7f9eacc6-032e-4696-bc08-145c43913221 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:09.330277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2c4f1492-e1b2-4b50-b379-060347b88c6f req-7f9eacc6-032e-4696-bc08-145c43913221 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:09.331062 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:09.331895 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:09.340259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:09.340458 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:09.340954 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:09.341743 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:09.342040 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:09.342407 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:09.343925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-2c4f1492-e1b2-4b50-b379-060347b88c6f req-7f9eacc6-032e-4696-bc08-145c43913221 service nova] Creating event network-vif-plugged:f4908d48-3b99-4092-8fc3-50909a3e1b00 for instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 on hv-cinder-83608 Aug 09 18:02:09.349318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-2c4f1492-e1b2-4b50-b379-060347b88c6f req-7f9eacc6-032e-4696-bc08-145c43913221 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038744 Aug 09 18:02:09.350328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 373/712] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:02:09.483149 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:09.491738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:09.493892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:09.495024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-818c20b3-5b2f-4b67-9fc9-f80bc2004ee9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.169799 Aug 09 18:02:09.495590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 340/713] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:09 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:10.312282 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:10.313628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:10.323266 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:10.323898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:10.324074 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:10.324786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:10.325210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:10.325626 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:10.471661 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:10.479918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0bd0959c-8b2b-4870-835c-6a6d2bd2150c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.172427 Aug 09 18:02:10.480453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 374/714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:10 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:10.519179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:10.519788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:10.527404 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:10.528079 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:10.529027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:10.529787 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:10.530280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:10.530713 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:10.673760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:10.682184 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:10.691313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:10.692516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-90aaa6b8-77ec-40d6-bcd1-ab07e77fca41 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.177684 Aug 09 18:02:10.693090 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 341/715] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:10 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:11.502150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:11.502727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:11.511104 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:11.511952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:11.512506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:11.513639 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:11.515517 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:11.515947 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:11.666510 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:11.676966 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-19741769-d9ad-4b5e-a981-e840650e453d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1367 microversion: 2.1 time: 0.178276 Aug 09 18:02:11.677260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 375/716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:11 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:11.720678 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:11.721320 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:11.723344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:11.724190 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=8 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:11.730773 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:11.731304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:11.731746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:11.732465 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:11.732921 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:11.733349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:11.875655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:11.884976 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:11.886503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:11.887698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e983038e-67b4-4701-997a-54e21717b856 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.171661 Aug 09 18:02:11.888285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 342/717] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:11 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:12.697460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:12.698070 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:12.704058 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:12.704540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:12.704971 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:12.705661 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:12.706183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:12.706517 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:12.846234 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:12.854189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0122fdb8-d0c2-4b41-a442-6abdc1cd61af tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1556 microversion: 2.1 time: 0.160485 Aug 09 18:02:12.854760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 376/718] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:12 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:12.874999 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:12.875531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:12.882203 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:12.883246 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:12.883688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:12.884379 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:12.884841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:12.885266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:12.909909 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:12.910610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:12.917161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:12.918498 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:12.919133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:12.920161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:12.920687 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:12.921191 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:12.979324 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-90c781d7-6003-4161-b789-d5a535f3aab0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108139 Aug 09 18:02:12.979938 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 343/719] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 9 18:02:12 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:02:13.085225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:13.096499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:13.097927 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:13.099294 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-286b59b4-a11d-471a-aaf0-fb7a88e84fc0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.192964 Aug 09 18:02:13.103467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 377/720] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:12 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:14.129073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:14.130885 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:14.141009 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:14.141223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:14.141768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:14.142474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:14.143349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:14.143769 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:14.198949 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:14.201226 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-7d5b4061-f520-4b8b-ba90-547bef3a59a0 req-ee7c95a6-f5ca-4b86-a9e3-612db3528dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abe122c-65b3-43db-aa85-c02ee6a4e1c1", "tag": "f4908d48-3b99-4092-8fc3-50909a3e1b00"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:14.211584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7d5b4061-f520-4b8b-ba90-547bef3a59a0 req-ee7c95a6-f5ca-4b86-a9e3-612db3528dd4 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:14.212151 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7d5b4061-f520-4b8b-ba90-547bef3a59a0 req-ee7c95a6-f5ca-4b86-a9e3-612db3528dd4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:14.213251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7d5b4061-f520-4b8b-ba90-547bef3a59a0 req-ee7c95a6-f5ca-4b86-a9e3-612db3528dd4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:14.231522 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-7d5b4061-f520-4b8b-ba90-547bef3a59a0 req-ee7c95a6-f5ca-4b86-a9e3-612db3528dd4 service nova] Creating event network-changed:f4908d48-3b99-4092-8fc3-50909a3e1b00 for instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 on hv-cinder-83608 Aug 09 18:02:14.237769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-7d5b4061-f520-4b8b-ba90-547bef3a59a0 req-ee7c95a6-f5ca-4b86-a9e3-612db3528dd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040244 Aug 09 18:02:14.238388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 378/721] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:02:14.323676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:14.332271 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:14.333848 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:14.335041 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b868df55-f25f-4fb8-8431-4238820e1ca9 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.215686 Aug 09 18:02:14.336166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 344/722] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:14 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:15.358851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:15.359685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:15.365900 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:15.366454 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:15.367436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:15.368146 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:15.368599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:15.369020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:15.516000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:15.525766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:15.527608 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:15.528963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-be6fb02f-13d2-403f-96a8-d355e82df120 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.174545 Aug 09 18:02:15.544113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 379/723] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:15 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:16.553738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:16.554861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:16.561037 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:16.561519 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:16.561956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:16.562649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:16.563147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:16.563563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:16.697474 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:16.705449 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:16.707130 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:16.708364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ce6e42c8-afed-4356-99ae-0efd30b52179 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.158566 Aug 09 18:02:16.709002 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 345/724] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:16 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:17.731409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:17.732000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:17.737917 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:17.738399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:17.738829 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:17.739539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:17.739990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:17.740408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:17.866583 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:17.874924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:17.876699 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:17.877834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e9e71c44-e245-436a-a33b-ede293798e65 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.150311 Aug 09 18:02:17.878390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 380/725] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:17 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:18.902170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:18.902775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:18.909247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:18.909732 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:18.910174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:18.910874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:18.911358 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:18.911786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:19.044190 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:19.052058 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:19.053576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:19.055345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-edd63ed1-5010-4643-89d8-4ef0c13e3be0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.156761 Aug 09 18:02:19.055916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 346/726] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:18 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:20.078163 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:20.078765 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:20.085821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:20.086389 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:20.086817 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:20.087693 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:20.088042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:20.088384 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:20.220494 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:20.229062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:20.230543 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:20.231722 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-db7fba59-9f2f-4dce-9f36-48bff04636dc tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.157479 Aug 09 18:02:20.232282 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 381/727] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:20 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:21.255027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:21.255664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:21.262122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:21.262611 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:21.263078 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:21.264073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:21.264267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:21.264694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:21.398453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:21.406590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:21.408106 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:21.409281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6add0cf7-b41e-4344-82d2-c6a7e91ef361 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1745 microversion: 2.20 time: 0.158628 Aug 09 18:02:21.409841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 347/728] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:21 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:22.434058 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:22.435287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:22.437390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:22.442492 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:22.443110 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:22.443618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:22.444551 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:22.444999 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:22.446144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:22.465825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:22.580382 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:22.589027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:22.590508 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:22.591688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0a862a16-e697-4d58-962c-690b9a94672f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.162105 Aug 09 18:02:22.592422 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 382/729] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:22 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:23.391525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-0206d8b6-a33b-4ac0-8d44-a066ab1f792d req-67e935c2-a0ba-4b0c-bee6-4ff1ffda2484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6e12fe-4b50-43ad-a12e-49a0575a710a", "name": "network-vif-plugged", "status": "completed", "tag": "01b7a043-db0a-49c0-9549-758464cbc252"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:23.406309 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0206d8b6-a33b-4ac0-8d44-a066ab1f792d req-67e935c2-a0ba-4b0c-bee6-4ff1ffda2484 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.407338 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0206d8b6-a33b-4ac0-8d44-a066ab1f792d req-67e935c2-a0ba-4b0c-bee6-4ff1ffda2484 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.408089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0206d8b6-a33b-4ac0-8d44-a066ab1f792d req-67e935c2-a0ba-4b0c-bee6-4ff1ffda2484 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.421089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-0206d8b6-a33b-4ac0-8d44-a066ab1f792d req-67e935c2-a0ba-4b0c-bee6-4ff1ffda2484 service nova] Creating event network-vif-plugged:01b7a043-db0a-49c0-9549-758464cbc252 for instance ff6e12fe-4b50-43ad-a12e-49a0575a710a on hv-cinder-83608 Aug 09 18:02:23.426851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-0206d8b6-a33b-4ac0-8d44-a066ab1f792d req-67e935c2-a0ba-4b0c-bee6-4ff1ffda2484 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039821 Aug 09 18:02:23.428521 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 348/730] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:02:23.619292 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:23.620550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:23.627469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.628227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.628822 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.629777 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.630144 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.630565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.776827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:23.785147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:23.786943 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:23.788321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af19dd40-b784-431e-bfe8-0731436d399c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.175625 Aug 09 18:02:23.789086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 383/731] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:23 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:24.812932 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:24.813740 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:24.816947 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:24.822459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:24.823340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:24.823988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:24.824778 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:24.825305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:24.825799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:24.990304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:24.999226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:25.001531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:25.003001 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-df0aa9ce-7fc7-4457-8d71-9234e61264dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.194762 Aug 09 18:02:25.003851 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 349/732] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:24 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:26.029763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:26.030626 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:26.036701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:26.037507 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:26.038136 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:26.039175 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:26.040394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:26.040887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:26.200481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:26.209248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:26.211621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:26.212474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1c9d9b3d-638f-4fb1-b17c-93bc6bb3d5f5 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.186646 Aug 09 18:02:26.213032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 384/733] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:26 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:27.241006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:27.241742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:27.249344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:27.250153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:27.250594 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:27.251586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:27.252206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:27.252627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:27.424427 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:27.434462 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:27.437050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:27.438225 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5dd4081c-1a11-4110-b5bf-67b4dde29458 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.201560 Aug 09 18:02:27.438803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 350/734] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:27 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:28.460884 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:28.462315 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:28.470684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:28.471666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:28.472337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:28.473260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:28.473951 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:28.474596 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:28.621623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:28.630473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:28.632002 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:28.637577 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e19e17d9-2e55-4c41-afa6-50a037c5d830 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.180402 Aug 09 18:02:28.647161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 385/735] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:28 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:29.665376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:29.665980 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:29.673259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:29.674079 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:29.675889 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:29.677631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:29.678804 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:29.680434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:29.850911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:29.863445 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:29.865145 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:29.866299 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b372f047-86b7-4a90-8fbb-238c80f8e24a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.204940 Aug 09 18:02:29.867074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 351/736] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:29 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:30.891271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:30.892518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:30.898682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:30.899519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:30.900178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:30.901154 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:30.902014 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:30.902552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:31.071634 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:31.082644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:31.084199 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:31.085529 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9fcc412d-be6b-4f7d-94e4-78c91ed1b554 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1740 microversion: 2.20 time: 0.198065 Aug 09 18:02:31.098998 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 386/737] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:30 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:32.109766 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:32.110374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:32.117600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:32.118084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:32.118527 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:32.119246 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:32.119720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:32.120182 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:32.252201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:32.260661 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:32.262166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:32.263373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1c5ba5be-6e4e-4425-b4a8-d4fc1d12570b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1722 microversion: 2.20 time: 0.157602 Aug 09 18:02:32.263946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 352/738] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:32 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:33.286739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:33.287381 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:33.293849 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:33.294346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:33.294839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:33.295708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:33.296161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:33.296587 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:33.446084 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:33.454274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:33.455821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:33.456986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b286a288-2b5b-41aa-91b1-8e95208a7b89 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1722 microversion: 2.20 time: 0.174426 Aug 09 18:02:33.457544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 387/739] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:33 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:34.480612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:34.481240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:34.487968 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:34.488460 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:34.488899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:34.489622 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:34.490072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:34.490498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:34.622931 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:34.631364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:34.632880 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:34.634551 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b80993d-03bc-494f-908a-0ee045e5de0a tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1722 microversion: 2.20 time: 0.158005 Aug 09 18:02:34.635426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 353/740] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:34 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:35.364699 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-06f73c5d-b5d9-4955-b3d7-8c2cd3f2dbe1 req-4bcf562c-1bcc-4c9c-87c6-f579e98ece40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6e12fe-4b50-43ad-a12e-49a0575a710a", "name": "network-vif-unplugged", "status": "completed", "tag": "01b7a043-db0a-49c0-9549-758464cbc252"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:35.377399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-06f73c5d-b5d9-4955-b3d7-8c2cd3f2dbe1 req-4bcf562c-1bcc-4c9c-87c6-f579e98ece40 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:35.378085 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-06f73c5d-b5d9-4955-b3d7-8c2cd3f2dbe1 req-4bcf562c-1bcc-4c9c-87c6-f579e98ece40 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:35.378760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-06f73c5d-b5d9-4955-b3d7-8c2cd3f2dbe1 req-4bcf562c-1bcc-4c9c-87c6-f579e98ece40 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:35.393965 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.compute.server_external_events [req-06f73c5d-b5d9-4955-b3d7-8c2cd3f2dbe1 req-4bcf562c-1bcc-4c9c-87c6-f579e98ece40 service nova] Unable to find a host for instance ff6e12fe-4b50-43ad-a12e-49a0575a710a. Dropping event network-vif-unplugged {{(pid=117886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:02:35.395427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-06f73c5d-b5d9-4955-b3d7-8c2cd3f2dbe1 req-4bcf562c-1bcc-4c9c-87c6-f579e98ece40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036931 Aug 09 18:02:35.396372 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 388/741] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 18:02:35.658145 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:35.658765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:35.665128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:35.666061 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:35.666591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:35.667325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:35.667783 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:35.668207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:35.801031 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:35.808979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:35.810482 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:35.811644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d898aa1-3681-43a5-946c-d00435f4c768 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1665 microversion: 2.20 time: 0.157547 Aug 09 18:02:35.812204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 354/742] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:35 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:35.833726 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08a4579d-5a31-48c8-8c36-e9e5498d4577"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:35.836000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:35.842310 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:35.842779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:35.843242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:35.843920 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:35.844360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:35.844771 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:36.129486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9037a29f-3b79-4e26-8fbd-b5165b8a6959 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299677 Aug 09 18:02:36.134031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 389/743] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Aug 9 18:02:35 2022] POST /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:02:36.251302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:36.251804 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:36.257717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:36.258200 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:36.258640 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:36.259422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:36.259877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:36.260301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:36.488171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f0d58f80-7833-4e09-b2e8-3ead51634794 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-volume_attachments/08a4579d-5a31-48c8-8c36-e9e5498d4577" status: 202 len: 0 microversion: 2.20 time: 0.241049 Aug 09 18:02:36.488761 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 355/744] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Aug 9 18:02:36 2022] DELETE /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-volume_attachments/08a4579d-5a31-48c8-8c36-e9e5498d4577 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:02:36.548056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:36.548718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:36.554821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:36.555336 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:36.555801 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:36.556467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:36.556910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:36.557504 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:36.586873 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117886) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:02:36.649172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05b349af-ea15-4184-a6ab-be46c5a0974b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "POST /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/action" status: 202 len: 0 microversion: 2.20 time: 0.105203 Aug 09 18:02:36.650311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 390/745] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 9 18:02:36 2022] POST /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:02:36.658608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:36.659260 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:36.666285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:36.666778 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:36.667247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:36.667950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:36.668410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:36.668841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:36.816203 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:36.826925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:36.828608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:36.829892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3100086a-7705-48d2-872b-9b4299396e3d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1673 microversion: 2.20 time: 0.175407 Aug 09 18:02:36.830454 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 356/746] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:36 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:37.854204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:37.854813 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:37.860771 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:37.861247 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:37.861682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:37.862359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:37.862809 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:37.863269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:37.997270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:38.005399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:38.006888 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:38.008068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c1226dc8-3e5b-468d-a81a-c7edad555475 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1673 microversion: 2.20 time: 0.158427 Aug 09 18:02:38.008621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 391/747] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:37 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:39.030809 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:39.031446 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:39.037805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:39.038284 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:39.038718 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:39.039428 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:39.039881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:39.040807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:39.175500 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:39.184094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:39.185580 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:39.186781 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2182bd6d-747b-46b1-b04f-a9c2a579fe9f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1673 microversion: 2.20 time: 0.160166 Aug 09 18:02:39.187378 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 357/748] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:39 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:40.209397 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:40.210091 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:40.216101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:40.216573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:40.216994 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:40.217676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:40.218130 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:40.218527 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:40.358380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:40.366661 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:40.369026 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:40.370278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6fb11585-a20a-4d79-b1f4-542e493194cf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.164754 Aug 09 18:02:40.370893 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 392/749] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:40 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:41.394412 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:41.395183 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:41.417657 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:41.422589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:41.423288 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:41.424358 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:41.425605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:41.427908 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:41.919817 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:41.928579 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:41.930167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:41.931953 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c11061c-8476-4ff2-8aa8-70138bca371c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.540910 Aug 09 18:02:41.932544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 358/750] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:41 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:42.956271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:42.961059 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:42.979216 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:42.979707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:42.980140 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:42.980831 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:42.981271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:42.981689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:43.194762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:43.203663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:43.205486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:43.207149 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d3f3aafd-5534-4711-8525-2e2c7aca6fce tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.255285 Aug 09 18:02:43.227060 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 393/751] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:42 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:44.248918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:44.249612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:44.256135 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:44.256653 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:44.257066 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:44.257792 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:44.258287 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:44.258736 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:44.269440 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:44.429044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:44.438012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:44.439541 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:44.440936 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6799d1b-8cd7-4ac2-8cf4-7f1155a33674 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.204878 Aug 09 18:02:44.442010 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 359/752] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:44 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:45.466114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:45.466728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:45.472840 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:45.473323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:45.473752 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:45.474493 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:45.475242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:45.476106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:45.628761 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:45.637468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:45.639134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:45.640341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e176285d-41ce-4dec-88d2-7c54d430d698 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.178783 Aug 09 18:02:45.651393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 394/753] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:45 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:46.665067 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:46.666500 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:46.675012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:46.675012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:46.675012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:46.676032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:46.676032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:46.676978 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:46.824402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:46.832573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:46.834071 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:46.835235 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b737deec-4673-4936-92bc-c87d41ec03a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.175628 Aug 09 18:02:46.835785 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 360/754] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:46 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:47.859438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:47.861089 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:47.872533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:47.873835 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:47.874852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:47.876973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:47.877419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:47.878435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:48.042017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:48.051459 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:48.052980 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:48.054349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f7d1ebe4-ab00-479c-b2e4-d412e4f76bda tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.199404 Aug 09 18:02:48.054907 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 395/755] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:47 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:49.078687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:49.079914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:49.086908 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:49.088375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:49.089004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:49.090299 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:49.090924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:49.091548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:49.245321 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:49.263639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:49.265149 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:49.275829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e1aa9fae-7e10-49e9-b4ff-811c4d23e8de tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.201161 Aug 09 18:02:49.276745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 361/756] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:49 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:50.298135 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:50.298719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:50.305231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:50.306381 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:50.306381 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:50.306780 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:50.307651 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:50.308083 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:50.312399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:50.448977 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:50.457001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:50.458508 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:50.459878 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e1a4742f-779b-4728-86f2-dd7615d2dc3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.165751 Aug 09 18:02:50.459878 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 396/757] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:50 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:51.484000 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:51.484575 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:51.490935 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:51.491533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:51.491975 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:51.492659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:51.493110 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:51.493533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:51.630377 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:51.638385 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:51.639915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:51.641070 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8c5be170-c425-4d82-abfd-65c70eade8dd tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.161031 Aug 09 18:02:51.641634 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 362/758] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:51 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:52.663585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:52.664198 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:52.666551 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:52.671741 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:52.672219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:52.672649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:52.673338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:52.673788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:52.674210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:52.803503 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:52.812121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:52.813653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:52.814797 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-103671da-c0bc-4ed3-a967-7b90b01bdb0d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.155089 Aug 09 18:02:52.815402 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 397/759] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:52 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:53.836849 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:53.837390 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:53.843680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:53.844161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:53.844594 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:53.845277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:53.845724 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:53.846143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:53.981280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:53.989242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:53.990744 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:53.991934 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6a28a888-261d-4aee-ad54-16769342ff8c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.159010 Aug 09 18:02:53.992503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 363/760] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:53 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:55.016784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:55.017390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:55.023989 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:55.024467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:55.025065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:55.025560 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:55.026639 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:55.027314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:55.158538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:55.166491 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:55.168030 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:55.169203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-270f2087-6f51-4353-a6c8-25e3943ff430 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.156286 Aug 09 18:02:55.169761 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 398/761] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:55 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:56.065708 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-780aaf0c-0d6f-4c1d-8403-7a0212a94774 req-3b40206f-bf6b-49c6-9975-25219a3f796e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6e12fe-4b50-43ad-a12e-49a0575a710a", "name": "network-vif-plugged", "status": "completed", "tag": "01b7a043-db0a-49c0-9549-758464cbc252"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:56.078849 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=30 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:56.081961 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-780aaf0c-0d6f-4c1d-8403-7a0212a94774 req-3b40206f-bf6b-49c6-9975-25219a3f796e service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:56.082448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-780aaf0c-0d6f-4c1d-8403-7a0212a94774 req-3b40206f-bf6b-49c6-9975-25219a3f796e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:56.083143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-780aaf0c-0d6f-4c1d-8403-7a0212a94774 req-3b40206f-bf6b-49c6-9975-25219a3f796e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:56.096821 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-780aaf0c-0d6f-4c1d-8403-7a0212a94774 req-3b40206f-bf6b-49c6-9975-25219a3f796e service nova] Creating event network-vif-plugged:01b7a043-db0a-49c0-9549-758464cbc252 for instance ff6e12fe-4b50-43ad-a12e-49a0575a710a on hv-cinder-83608 Aug 09 18:02:56.103085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-780aaf0c-0d6f-4c1d-8403-7a0212a94774 req-3b40206f-bf6b-49c6-9975-25219a3f796e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041909 Aug 09 18:02:56.103806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 364/762] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:02:56.192125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:56.192739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:56.200805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:56.201289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:56.201874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:56.202397 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:56.202845 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:56.203949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:56.346374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:56.354800 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:56.356623 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:56.358075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-803068b7-8246-4ecf-b56e-7db193c715e1 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.169719 Aug 09 18:02:56.371148 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 399/763] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:56 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:57.369325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:57.369941 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:57.377376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:57.377864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:57.378302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:57.379023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:57.379483 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:57.379910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:57.381604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:57.382204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:57.388009 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:57.388479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:57.388899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:57.389575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:57.390014 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:57.390428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:57.405435 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ce00fd28-dd9a-48a6-b42d-408f2704fd25 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/ips" status: 200 len: 144 microversion: 2.1 time: 0.042351 Aug 09 18:02:57.406098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 365/764] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 18:02:57 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:02:57.525209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:57.536122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:57.537889 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:57.539197 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b050f20d-090b-4634-9935-ef47190cb31b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1731 microversion: 2.20 time: 0.161473 Aug 09 18:02:57.539784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 400/765] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:57 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:02:58.565830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:58.566639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:58.574207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:58.574883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:58.575853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:58.576731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:58.577266 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:58.577764 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:58.711102 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:58.719610 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:58.721194 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:58.722471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-00f01226-b017-4e19-abf8-514f0336a80f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1718 microversion: 2.20 time: 0.160665 Aug 09 18:02:58.723368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 366/766] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:02:58 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:02:58.768253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "210e245c-91d4-4cc1-905c-9a08eb1828be"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:58.770765 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:58.777371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:58.777852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:58.778285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:58.779109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:58.779438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:58.779921 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:59.046652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-582fa4f9-4c59-4ae4-bc5a-7970cd026f37 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282502 Aug 09 18:02:59.047289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 401/767] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:02:58 2022] POST /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:01.466507 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:01.467032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:01.473479 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:01.473964 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:01.474398 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:01.475126 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:01.475582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:01.476006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:01.500521 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7e480557-9d5b-4ea5-b464-ba270719b113 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/ips" status: 200 len: 148 microversion: 2.1 time: 0.037722 Aug 09 18:03:01.503852 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 367/768] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 18:03:01 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:02.862818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23079cd6-e624-4597-b076-876194fad495"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:02.865712 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:02.871869 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:02.872356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:02.872780 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:02.873468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:02.873908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:02.874318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:03.133545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0b0085b1-0182-40ba-9d97-b1a24e351ec6 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "POST /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275362 Aug 09 18:03:03.134150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 402/769] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:03:02 2022] POST /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:06.586422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:06.588658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:06.595740 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:06.596226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:06.596663 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:06.597354 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:06.597803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:06.598227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:06.628268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4481938c-c5f1-46cd-9c2e-a0e4cf91dfb6 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Aug 09 18:03:06.629245 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 368/770] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:06 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:06.640959 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:06.641565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:06.647690 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:06.648169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:06.648599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:06.649286 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:06.649736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:06.650156 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:06.679594 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-194cd6f0-c0c1-4bf5-822e-e53daebd9b36 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/210e245c-91d4-4cc1-905c-9a08eb1828be" status: 200 len: 194 microversion: 2.1 time: 0.043623 Aug 09 18:03:06.680570 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 403/771] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 9 18:03:06 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/210e245c-91d4-4cc1-905c-9a08eb1828be => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:08.036086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "779f20af-d147-4117-b25b-defa755bc3e6"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:08.038590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:08.046047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:08.046607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:08.047159 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:08.047867 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:08.048322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:08.048763 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:08.080865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1588677081", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:08.133941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] validate_networks() for None {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:03:08.310752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b6030039-6150-4675-ab63-e4614a61fbbe tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "POST /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278481 Aug 09 18:03:08.311563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 369/772] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:03:08 2022] POST /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:08.426090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:03:08.426574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:03:08.427079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:03:08.427490 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:03:08.428076 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:03:08.436612 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:08.437091 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:08.437521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:08.438236 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:08.438686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:08.439145 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:08.456210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Getting quotas for project 26f43f9c051f40f2a208183bc5e14698. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:03:08.460185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Getting quotas for user f580181bfbf34f8fa18c2097f4ce9ec3 and project 26f43f9c051f40f2a208183bc5e14698. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:03:08.471642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:03:08.473879 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:03:08.517625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e5cfde86-b568-435e-bd46-cef5de002d53 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.440729 Aug 09 18:03:08.518543 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 404/773] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:03:08.530891 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c530d5d-41ba-45bf-87d9-d4b75845527d tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:08.532237 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c530d5d-41ba-45bf-87d9-d4b75845527d tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:08.588411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c530d5d-41ba-45bf-87d9-d4b75845527d tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:08.596063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c530d5d-41ba-45bf-87d9-d4b75845527d tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1215 microversion: 2.1 time: 0.070256 Aug 09 18:03:08.596720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 370/774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:08 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:09.618121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:09.619404 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:09.628804 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:09.629703 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:09.631352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:09.632395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:09.633622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:09.634227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:09.704534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:09.715964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9e8d2bf1-1b96-41db-966d-6e09d84b8fc0 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1285 microversion: 2.1 time: 0.101696 Aug 09 18:03:09.716872 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 405/775] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:09 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:10.742132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:10.743651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:10.754430 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:10.755604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:10.755604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:10.756415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:10.756722 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:10.757208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:10.894846 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:10.902443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1aa52bec-cf47-415d-bda5-e69d29e221fc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.168072 Aug 09 18:03:10.903120 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 371/776] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:10 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:11.146332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-98f9aba1-ad7e-465d-b801-5bdad1271c92 req-8068bb3e-1cab-43a5-b126-4494e479a694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92", "tag": "0c57298d-27dc-4b25-b113-1c939c59b99f"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:11.156162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-98f9aba1-ad7e-465d-b801-5bdad1271c92 req-8068bb3e-1cab-43a5-b126-4494e479a694 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:11.156624 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-98f9aba1-ad7e-465d-b801-5bdad1271c92 req-8068bb3e-1cab-43a5-b126-4494e479a694 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:11.157044 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-98f9aba1-ad7e-465d-b801-5bdad1271c92 req-8068bb3e-1cab-43a5-b126-4494e479a694 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:11.167554 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-98f9aba1-ad7e-465d-b801-5bdad1271c92 req-8068bb3e-1cab-43a5-b126-4494e479a694 service nova] Creating event network-changed:0c57298d-27dc-4b25-b113-1c939c59b99f for instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 on hv-cinder-83608 Aug 09 18:03:11.172858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-98f9aba1-ad7e-465d-b801-5bdad1271c92 req-8068bb3e-1cab-43a5-b126-4494e479a694 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030264 Aug 09 18:03:11.173633 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 406/777] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:03:11.923860 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:11.924480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:11.931453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:11.931940 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:11.932378 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:11.933080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:11.933525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:11.933946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:12.076316 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:12.083949 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-075f1f10-40f4-4e5d-a3b2-c5b9a7a4e891 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.163845 Aug 09 18:03:12.084816 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 372/778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:11 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:12.917058 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:12.917627 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:12.923674 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:12.924152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:12.924731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:12.925427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:12.925971 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:12.926435 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:13.006942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lazy-loading 'services' on Instance uuid 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:13.078131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ff7b4f55-347a-45e7-910b-481d6e64feda tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments/23079cd6-e624-4597-b076-876194fad495" status: 202 len: 0 microversion: 2.1 time: 0.165565 Aug 09 18:03:13.078735 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 407/779] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:03:12 2022] DELETE /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments/23079cd6-e624-4597-b076-876194fad495 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:03:13.087083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:13.089326 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:13.096218 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:13.096698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:13.097135 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:13.097820 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:13.098273 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:13.098693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:13.105830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:13.106576 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:13.113487 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:13.113860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:13.114290 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:13.115001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:13.115465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:13.115885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:13.129531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7ae925f4-8531-44d5-84d3-7c405d0227ed tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Aug 09 18:03:13.130454 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 373/780] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:13 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:13.242904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:13.250179 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f4184e66-2102-474a-8789-0c65b742b1cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.148432 Aug 09 18:03:13.250740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 408/781] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:13 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:14.143301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:14.145389 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:14.151527 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:14.152015 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:14.152455 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:14.153157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:14.154470 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:14.154936 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:14.186273 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8834c7e9-3d10-4f78-83ab-e3a45af39725 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048455 Aug 09 18:03:14.186840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 374/782] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:14 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:14.271158 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:14.271740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:14.278039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:14.279077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:14.279514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:14.280195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:14.280644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:14.281065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:14.415480 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:14.423461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8eecc47e-3c68-4088-ba8a-70c517306398 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.156201 Aug 09 18:03:14.424033 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 409/783] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:14 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:15.197864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:15.199996 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:15.206347 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:15.206826 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:15.207310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:15.207988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:15.208433 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:15.208855 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:15.211351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:15.240709 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-971b2394-5ccf-43d0-b6cb-3467504ad32f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046860 Aug 09 18:03:15.241267 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 375/784] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:15 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:15.443915 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:15.444551 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:15.451463 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:15.451945 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:15.452413 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:15.453100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:15.453552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:15.453977 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:15.582298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:15.585908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:15.590922 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b3c52938-32e3-462e-b5dd-4516639cd7cf tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.150842 Aug 09 18:03:15.591510 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 410/785] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:15 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:16.253593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:16.255702 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:16.262169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:16.262648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:16.263619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:16.264301 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:16.264756 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:16.265176 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:16.293666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4a296713-55c3-4620-8b1d-a6f50e537a49 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044408 Aug 09 18:03:16.295436 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 376/786] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:16 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:16.613361 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:16.613981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:16.621661 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:16.622174 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:16.622620 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:16.623405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:16.623862 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:16.624284 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:16.756021 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:16.763943 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-da602a61-3705-4a4b-9175-8302c7c7ddc9 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.155913 Aug 09 18:03:16.764503 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 411/787] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:16 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:17.307056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:17.309231 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:17.315906 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:17.316391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:17.316828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:17.317515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:17.317964 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:17.318409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:17.346890 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67a3062c-2485-40e6-aafb-600843937c9a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043837 Aug 09 18:03:17.347472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 377/788] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:17 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:17.785646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:17.786168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:17.792612 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:17.793086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:17.793518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:17.794706 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:17.795189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:17.795611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:17.932272 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:17.940234 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-255739bd-4914-4b74-8a57-a227b65f2ab6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.158578 Aug 09 18:03:17.940799 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 412/789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:17 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:18.117435 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-144e13ce-7651-49fc-bfd8-863291541132 req-047958a0-ca63-4df9-a837-5a4584c86d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92", "name": "network-vif-plugged", "status": "completed", "tag": "0c57298d-27dc-4b25-b113-1c939c59b99f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:18.127750 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-144e13ce-7651-49fc-bfd8-863291541132 req-047958a0-ca63-4df9-a837-5a4584c86d8d service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:18.128384 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-144e13ce-7651-49fc-bfd8-863291541132 req-047958a0-ca63-4df9-a837-5a4584c86d8d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:18.129081 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-144e13ce-7651-49fc-bfd8-863291541132 req-047958a0-ca63-4df9-a837-5a4584c86d8d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:18.141455 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-144e13ce-7651-49fc-bfd8-863291541132 req-047958a0-ca63-4df9-a837-5a4584c86d8d service nova] Creating event network-vif-plugged:0c57298d-27dc-4b25-b113-1c939c59b99f for instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 on hv-cinder-83608 Aug 09 18:03:18.146309 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-144e13ce-7651-49fc-bfd8-863291541132 req-047958a0-ca63-4df9-a837-5a4584c86d8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Aug 09 18:03:18.146910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 378/790] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:18.360528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:18.362900 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:18.368912 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:18.369394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:18.369826 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:18.370659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:18.371946 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:18.372618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:18.404409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b3ba6390-3265-4ddb-a808-0772bf402a8d tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Aug 09 18:03:18.404975 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 413/791] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:18 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:18.963990 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:18.968210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:18.968914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:18.975322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:18.975800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:18.976233 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:18.978840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:18.978840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:18.978840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:19.108077 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:19.115757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a594110-033b-4505-ab1d-ab364d67651e tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.152925 Aug 09 18:03:19.116091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 379/792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:18 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:19.416651 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:19.418839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:19.420704 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:19.421354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:19.427476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:19.427944 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:19.428368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:19.429039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:19.429483 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:19.429932 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:19.458438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ae29ef72-d102-4c3f-9130-a2bef259efad tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Aug 09 18:03:19.458919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 414/793] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:19 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:20.138268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:20.138881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:20.146175 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:20.146669 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:20.147134 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:20.148590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:20.149207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:20.149695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:20.282941 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:20.290409 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5eae6c7b-a151-4e4c-a7a8-39cc9ebf1844 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1315 microversion: 2.1 time: 0.157248 Aug 09 18:03:20.291007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 380/794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:20 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:20.470673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:20.472894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:20.479447 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:20.479927 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:20.480358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:20.481047 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:20.482295 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:20.482657 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:20.511093 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1e604c68-8f9f-4a7f-82aa-3df255d7c239 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 Aug 09 18:03:20.511648 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 415/795] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:20 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:21.310539 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:21.311109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:21.317583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.318068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.318504 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.319305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.319685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.320105 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.447247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:21.455171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4ca41d4f-a83a-4aa0-bb7e-550328eec972 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1464 microversion: 2.1 time: 0.148525 Aug 09 18:03:21.455746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 381/796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:21 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:21.505437 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:21.505949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:21.512312 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.513344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.513775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.514515 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.514959 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.515399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.522598 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:21.525011 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:21.531602 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.532312 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.532686 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.533404 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.533847 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.534269 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.544252 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:03:21.564664 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bbcf63b1-fb06-4a58-b3b3-17810fadf55c tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046070 Aug 09 18:03:21.565189 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 382/797] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:21 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:03:21.621019 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2aac5148-a316-4a92-a3e2-30fc2582af20 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 204 len: 0 microversion: 2.1 time: 0.119388 Aug 09 18:03:21.621604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 416/798] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:21 2022] DELETE /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:03:21.630736 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:21.631410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:21.638009 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.638565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.639058 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.639793 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.640420 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.640862 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.776819 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:21.784693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-930fad3e-2f74-4e4f-996e-f4b604ab6b38 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1470 microversion: 2.1 time: 0.158123 Aug 09 18:03:21.785257 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 383/799] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:21 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:22.191788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:22.194057 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:22.200017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.200490 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.200927 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.201609 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.202062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.202481 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.232106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-35b8ca57-661f-4f62-b27b-9d5519f9dc1d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044028 Aug 09 18:03:22.232659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 417/800] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:22 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:22.385749 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:22.386310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:22.393162 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.393647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.394085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.394776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.395262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.395688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.425398 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8a7a0289-6e94-45d4-b79f-a553aa7a97da tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/210e245c-91d4-4cc1-905c-9a08eb1828be" status: 200 len: 194 microversion: 2.1 time: 0.043570 Aug 09 18:03:22.425975 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 384/801] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 9 18:03:22 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/210e245c-91d4-4cc1-905c-9a08eb1828be => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:22.436271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:22.436795 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:22.442613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.443128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.443559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.444239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.444686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.445110 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.524699 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lazy-loading 'services' on Instance uuid 033ec247-be83-408c-8635-e4cfe8a6212f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:22.577185 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:22.579452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:22.585607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.586101 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.586534 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.587328 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.587777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.588196 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.597412 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a45eeb98-c44d-4e7a-badb-56784ea68e6b tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/210e245c-91d4-4cc1-905c-9a08eb1828be" status: 202 len: 0 microversion: 2.1 time: 0.164684 Aug 09 18:03:22.601399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 418/802] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:03:22 2022] DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/210e245c-91d4-4cc1-905c-9a08eb1828be => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:03:22.620514 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-584e104c-a567-4bed-b311-9290a253a979 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047343 Aug 09 18:03:22.621087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 385/803] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:22 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:03:22.806121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:22.806823 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:22.808816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:22.814762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.815861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.816299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.816986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:22.817440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:22.817859 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.947801 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:22.955115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-372ef4f7-1cf8-42ee-a8d0-9136262aebcc tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1470 microversion: 2.1 time: 0.153154 Aug 09 18:03:22.955676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 419/804] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:22 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:23.633312 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:23.635471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:23.642506 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:23.642953 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:23.643480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:23.644170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:23.644591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:23.645016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:23.676211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-170901cf-f642-46d9-a243-0796978bd9b0 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046751 Aug 09 18:03:23.676800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 386/805] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:23 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:23.975984 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:23.977378 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:23.986440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:23.986440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:23.986440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:23.986832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:23.987320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:23.987732 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.139033 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:24.146914 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6b815bf2-180f-4dfd-9cf5-a4f275a03a80 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1470 microversion: 2.1 time: 0.174553 Aug 09 18:03:24.147625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 420/806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:23 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:24.347130 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-33f8cf28-c995-4589-808e-dd430d17da6a req-4e6669da-7521-4ac3-9136-09f29a5d77b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92", "name": "network-vif-deleted", "tag": "0c57298d-27dc-4b25-b113-1c939c59b99f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:24.357255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-33f8cf28-c995-4589-808e-dd430d17da6a req-4e6669da-7521-4ac3-9136-09f29a5d77b1 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.357815 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-33f8cf28-c995-4589-808e-dd430d17da6a req-4e6669da-7521-4ac3-9136-09f29a5d77b1 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.358307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-33f8cf28-c995-4589-808e-dd430d17da6a req-4e6669da-7521-4ac3-9136-09f29a5d77b1 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.370112 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-33f8cf28-c995-4589-808e-dd430d17da6a req-4e6669da-7521-4ac3-9136-09f29a5d77b1 service nova] Creating event network-vif-deleted:0c57298d-27dc-4b25-b113-1c939c59b99f for instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 on hv-cinder-83608 Aug 09 18:03:24.375848 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-33f8cf28-c995-4589-808e-dd430d17da6a req-4e6669da-7521-4ac3-9136-09f29a5d77b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Aug 09 18:03:24.376822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 387/807] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:24.689314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:24.691823 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:24.699271 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.699759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.700860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.701560 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.702012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.702577 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.733633 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e1a319c2-b29c-4e69-a496-f13093a3f969 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048877 Aug 09 18:03:24.734207 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 421/808] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:24 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:03:24.798359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:24.798946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:24.805080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.805567 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.806006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.806704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.807192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.807625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.832482 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:03:24.913214 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a5e6ea62-16f5-48fa-9ef2-5d14b8427759 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 204 len: 0 microversion: 2.1 time: 0.119638 Aug 09 18:03:24.914117 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 388/809] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:24 2022] DELETE /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:03:24.922855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:24.923575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:24.929861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.930377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.930809 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.931540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.931992 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.932426 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:25.064703 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:25.072337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f8e24412-f88f-4a63-bdb9-0c21ff510298 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1680 microversion: 2.1 time: 0.153519 Aug 09 18:03:25.072910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 422/810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:24 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:25.169356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:25.170096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:25.175911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:25.176392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:25.176824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:25.177506 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:25.177958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:25.178375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:25.208235 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:25.208709 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:25.209137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:25.209580 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lazy-loading 'fault' on Instance uuid fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:25.250790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:25.258759 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ae99715d-01da-4ac8-acc8-a5c855aeaf55 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1305 microversion: 2.1 time: 0.094178 Aug 09 18:03:25.259366 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 389/811] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:25 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:26.094088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:26.094697 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:26.101110 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.101580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.102007 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.102688 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.103178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.103603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.235857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:26.243207 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-332a5552-4c87-471f-9b6e-76701480cf4f tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1680 microversion: 2.1 time: 0.153463 Aug 09 18:03:26.243775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 423/812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:26 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:26.281084 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:26.281702 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:26.284180 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:26.290137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.290783 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.291255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.291952 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.292407 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.292832 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.324588 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.325548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.325959 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.326400 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lazy-loading 'fault' on Instance uuid fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:26.366016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f580181bfbf34f8fa18c2097f4ce9ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f43f9c051f40f2a208183bc5e14698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:26.368194 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:26.374515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ad8491fe-2cc3-486c-9a5f-8e51c7c20143 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 200 len: 1305 microversion: 2.1 time: 0.098015 Aug 09 18:03:26.375119 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 390/813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:26 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:26.899903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:26.900400 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:26.906565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.907079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.907516 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.908202 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.908653 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.909084 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.937562 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-593cc501-3ffa-4b1e-94b7-c3eda613d5e8 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/779f20af-d147-4117-b25b-defa755bc3e6" status: 200 len: 194 microversion: 2.1 time: 0.041677 Aug 09 18:03:26.938141 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 424/814] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 9 18:03:26 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/779f20af-d147-4117-b25b-defa755bc3e6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:26.949279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:26.949777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:26.956899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.957419 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.957862 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.958555 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.959041 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.959469 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:27.047434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lazy-loading 'services' on Instance uuid 033ec247-be83-408c-8635-e4cfe8a6212f {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:27.124738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1d621497-f29a-4ecc-a8f0-95082743707c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/779f20af-d147-4117-b25b-defa755bc3e6" status: 202 len: 0 microversion: 2.1 time: 0.179599 Aug 09 18:03:27.125681 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 391/815] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:03:26 2022] DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments/779f20af-d147-4117-b25b-defa755bc3e6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:03:27.264882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:27.265595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:27.272131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:27.272611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:27.273043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:27.273738 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:27.274191 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:27.274615 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:27.280450 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:27.396562 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:27.397279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] [instance: fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:27.404425 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:27.404917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:27.405362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:27.406191 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:27.406529 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:27.406957 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:27.413168 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:27.421303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-65dfcbed-ef20-4416-8924-ddf6ce3a988e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1680 microversion: 2.1 time: 0.160626 Aug 09 18:03:27.422177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 425/816] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:27 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:27.586508 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] HTTP exception thrown: Instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 could not be found. Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Request method failure captured: Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 HTTP/1.1 Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qFaVjXTfw8-8Q9L-RDY70vYuk-qrN-wbQzSg1zmq8vqySyTYj14raqiyl5Lj8tyaUtHzP6PQAcAHrtB0W02LUZedN0nfGIUNUkYmv-Li44aSXblPS1IPNgzdfdMwBdO5hLqM3QXR58yhET3K73Gqn5izmGTjp5wCmrCVWL46gG5C40 Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 26f43f9c051f40f2a208183bc5e14698 Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-1219485408 Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:27.588192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/26f43f9c051f40f2a208183bc5e14698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26f43f9c051f40f2a208183bc5e14698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26f43f9c051f40f2a208183bc5e14698"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_26f43f9c051f40f2a208183bc5e14698", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-1219485408 Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 26f43f9c051f40f2a208183bc5e14698 Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-1219485408 Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-1219485408-project Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: f580181bfbf34f8fa18c2097f4ce9ec3 Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-1219485408-project Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 could not be found. Aug 09 18:03:27.589837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92'} Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 could not be found. Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:27.591790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 could not be found. Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 could not be found. Aug 09 18:03:27.593794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:27.596043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] Returning 404 to user: Instance fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:27.596043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-60a259a8-cc50-413d-a294-adbf9bff2af6 tempest-VolumesNegativeTest-1219485408 tempest-VolumesNegativeTest-1219485408-project] 10.222.0.52 "GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92" status: 404 len: 111 microversion: 2.1 time: 0.197197 Aug 09 18:03:27.596043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 392/817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:27 2022] GET /compute/v2.1/servers/fbcc7e91-c1fc-4e6a-bdb9-b1c04b2dab92 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:28.290356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-62921dd6-2836-408e-b61c-20b06836d475 req-6a997f83-d131-492f-9535-e83fc0f66c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abe122c-65b3-43db-aa85-c02ee6a4e1c1", "name": "network-vif-deleted", "tag": "f4908d48-3b99-4092-8fc3-50909a3e1b00"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:28.312596 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-62921dd6-2836-408e-b61c-20b06836d475 req-6a997f83-d131-492f-9535-e83fc0f66c2d service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.313072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-62921dd6-2836-408e-b61c-20b06836d475 req-6a997f83-d131-492f-9535-e83fc0f66c2d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.314158 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-62921dd6-2836-408e-b61c-20b06836d475 req-6a997f83-d131-492f-9535-e83fc0f66c2d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.342910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-62921dd6-2836-408e-b61c-20b06836d475 req-6a997f83-d131-492f-9535-e83fc0f66c2d service nova] Creating event network-vif-deleted:f4908d48-3b99-4092-8fc3-50909a3e1b00 for instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 on hv-cinder-83608 Aug 09 18:03:28.352326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-62921dd6-2836-408e-b61c-20b06836d475 req-6a997f83-d131-492f-9535-e83fc0f66c2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065404 Aug 09 18:03:28.353903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 426/818] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:28.359012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:28.364139 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:28.376758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.377828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.378468 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.380007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.380727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.381429 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.424746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-325f30e2-2570-4ea6-ae70-c46aa6febd54 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072174 Aug 09 18:03:28.427078 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 393/819] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:28 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:03:28.446161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:28.449263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:28.469354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.470092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.470740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.471760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.472467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.473124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.534305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.535133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.535770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.536472 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lazy-loading 'fault' on Instance uuid 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:28.590389 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:28.594903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:28.596700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:28.605982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.607099 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.607763 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.609075 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.609683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.610199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.611949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1edd49fd-ccb8-47c6-aeaf-9396f5820f6e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1331 microversion: 2.1 time: 0.171591 Aug 09 18:03:28.623770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 427/820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:28 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1331 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:28.661758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f92aba08-4e26-4ee1-bd58-22e19bb3fd21 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075297 Aug 09 18:03:28.662402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 394/821] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:03:28 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:03:28.728434 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:28.728982 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:28.736007 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.736485 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.736928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.737787 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.738237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.738729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.776127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:03:28.879717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb5c103a-c456-4b6a-81ff-8e841105166e tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 204 len: 0 microversion: 2.1 time: 0.155419 Aug 09 18:03:28.880574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 428/822] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:28 2022] DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:03:28.891668 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:28.892475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:28.899846 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.900325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.900756 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.901442 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:28.902329 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:28.902748 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:29.051798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:29.060223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-65b9706b-a9be-4b3a-b5d1-7a0df2f8d7db tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1670 microversion: 2.1 time: 0.173084 Aug 09 18:03:29.060891 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 395/823] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:28 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:29.635400 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:29.640592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:29.647039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:29.647847 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:29.648285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:29.649122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:29.649576 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:29.649997 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:29.684660 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:29.685033 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:29.685469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:29.685939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lazy-loading 'fault' on Instance uuid 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:29.732572 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:29.740332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71bcbb30-1f0d-4bfc-a8c6-209ca2945bcf tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1331 microversion: 2.1 time: 0.109257 Aug 09 18:03:29.740856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 429/824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:29 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:30.082362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:30.083443 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:30.093806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:30.094600 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:30.095442 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:30.096422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:30.097021 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:30.097654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:30.243565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:30.251978 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ce80dcad-eb29-4088-b755-f112decad769 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1670 microversion: 2.1 time: 0.174230 Aug 09 18:03:30.252810 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 396/825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:30 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:30.761507 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:30.762148 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:30.769915 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:30.770408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:30.770840 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:30.771566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:30.772017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:30.772437 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:30.811258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:30.812061 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:30.812789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:30.813701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lazy-loading 'fault' on Instance uuid 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:30.865734 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a0e3ac431440582d3dca1fe246ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9182ab0c79d4b8a9de4c319491ca316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:30.874408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-57704a1e-266c-4f5b-b076-24cf0f1463e4 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 200 len: 1331 microversion: 2.1 time: 0.116799 Aug 09 18:03:30.875071 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 430/826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:30 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:31.273943 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:31.274579 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:31.281256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.281484 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.281916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.282604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.283073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.283499 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.412211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:31.420248 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ddbd546e-d8a7-45c8-8391-b8f81a629201 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1670 microversion: 2.1 time: 0.150199 Aug 09 18:03:31.420827 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 397/827] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:31 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:31.899300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:31.899911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:31.908292 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.908782 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.909214 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.909905 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.910356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.910773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.925332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 HTTP/1.1 Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:31.929875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:31.931215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '4abe122c-65b3-43db-aa85-c02ee6a4e1c1'} Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:31.932390 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:31.933613 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:31.935541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:31.935541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-29c16f1b-ebe8-4ebe-92df-575d59a39dee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 404 len: 111 microversion: 2.1 time: 0.035809 Aug 09 18:03:31.935541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 431/828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:31 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:31.940692 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7746e40b-b9b7-4c09-b717-a453ec9d47ee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '.version_select at 0x7f8c067b2f70>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:31.961032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7746e40b-b9b7-4c09-b717-a453ec9d47ee tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747073330" status: 202 len: 0 microversion: 2.1 time: 0.024042 Aug 09 18:03:31.965835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 398/829] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 9 18:03:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747073330 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:03:32.095215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-cf6d70c4-7ecd-43b9-828b-9bb707daf725 req-9a135ea4-176f-4dcf-845f-7a8860a22686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033ec247-be83-408c-8635-e4cfe8a6212f", "name": "network-vif-deleted", "tag": "37dfc28e-1441-459f-913c-19b30ae3957b"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:32.116250 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cf6d70c4-7ecd-43b9-828b-9bb707daf725 req-9a135ea4-176f-4dcf-845f-7a8860a22686 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:32.116736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cf6d70c4-7ecd-43b9-828b-9bb707daf725 req-9a135ea4-176f-4dcf-845f-7a8860a22686 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:32.117394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cf6d70c4-7ecd-43b9-828b-9bb707daf725 req-9a135ea4-176f-4dcf-845f-7a8860a22686 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:32.138753 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-cf6d70c4-7ecd-43b9-828b-9bb707daf725 req-9a135ea4-176f-4dcf-845f-7a8860a22686 service nova] Creating event network-vif-deleted:37dfc28e-1441-459f-913c-19b30ae3957b for instance 033ec247-be83-408c-8635-e4cfe8a6212f on hv-cinder-83608 Aug 09 18:03:32.150584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-cf6d70c4-7ecd-43b9-828b-9bb707daf725 req-9a135ea4-176f-4dcf-845f-7a8860a22686 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061647 Aug 09 18:03:32.152752 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 432/830] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:32.443375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:32.446797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:32.454566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:32.455222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:32.455890 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:32.456612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:32.457074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:32.457503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:32.507710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:32.508293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:32.508805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:32.509328 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lazy-loading 'fault' on Instance uuid 033ec247-be83-408c-8635-e4cfe8a6212f {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:32.582181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb11c04acb4f40cd9d09edf16b11abb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6816355a42d64d5988aff83532ff5888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:32.593080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-04ebdd2a-dc18-483c-bc04-a4bff3af6855 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 200 len: 1326 microversion: 2.1 time: 0.154866 Aug 09 18:03:32.594382 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 399/831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:32 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:33.616670 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:33.617383 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:33.625912 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:33.626843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:33.627333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:33.628219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:33.628678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:33.629273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:33.644332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] HTTP exception thrown: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Request method failure captured: Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f HTTP/1.1 Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p--1aZBoRGQoD7CLYvQHdVFpy5xtEspE6DtCjLsHoeEqSfW3ostQg76NkmL74CZ6lKQXRkoAk7zTjm69p5yUUfLK5wB1OaazwVv-nBrb-F5aE7SOFVgiG37wTR0JGZ6uBR76j2-En2Du4NaHrGEj4kJ3Eg_DFelX2Z5j0mNZj1jxnM Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:33.645996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6816355a42d64d5988aff83532ff5888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6816355a42d64d5988aff83532ff5888", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: cb11c04acb4f40cd9d09edf16b11abb0 Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:33.647593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '033ec247-be83-408c-8635-e4cfe8a6212f'} Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:33.648461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:33.649866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:33.651566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Returning 404 to user: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:33.651566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-42c06c4d-0d9e-4d4e-8dca-d6803294550d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 404 len: 111 microversion: 2.1 time: 0.034956 Aug 09 18:03:33.651566 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 433/832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:33 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:33.660255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-180aaf36-6550-4d75-a958-7c2717c4a6a2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '.version_select at 0x7f8c0679dd30>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:33.678302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-180aaf36-6550-4d75-a958-7c2717c4a6a2 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994094190" status: 202 len: 0 microversion: 2.1 time: 0.021773 Aug 09 18:03:33.678871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 400/833] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 9 18:03:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994094190 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:03:34.016644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:34.017149 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:34.023301 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:34.023782 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:34.024214 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:34.024908 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:34.025388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:34.025811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:34.040003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 HTTP/1.1 Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:34.041650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.043351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '4abe122c-65b3-43db-aa85-c02ee6a4e1c1'} Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:34.044248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.045716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.047253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:34.047253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8e8c6ae6-88ed-4f1b-aa09-23f669266172 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 404 len: 111 microversion: 2.1 time: 0.032986 Aug 09 18:03:34.047253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 434/834] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:34 2022] DELETE /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:34.054532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:34.055181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 4abe122c-65b3-43db-aa85-c02ee6a4e1c1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:34.067123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:34.067682 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:34.068171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:34.069038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:34.069487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:34.069904 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:34.084746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 HTTP/1.1 Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:34.086307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.087912 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '4abe122c-65b3-43db-aa85-c02ee6a4e1c1'} Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:34.092303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. Aug 09 18:03:34.093892 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:34.095659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 4abe122c-65b3-43db-aa85-c02ee6a4e1c1 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:34.095659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a8f3c314-027b-4aa6-a11d-1c822b2b3090 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1" status: 404 len: 111 microversion: 2.1 time: 0.037132 Aug 09 18:03:34.095659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 401/835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:34 2022] GET /compute/v2.1/servers/4abe122c-65b3-43db-aa85-c02ee6a4e1c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:35.231990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:35.232497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:35.238955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.239467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.240086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.240775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.241225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.241646 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.255912 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 HTTP/1.1 Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:35.257584 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.259183 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '583dd4cf-1ee5-4244-bec6-a9fc62f38403'} Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:35.260206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.261649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.263220 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:35.263220 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-59f2041e-e4d6-4553-9001-7a9149c04540 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 404 len: 111 microversion: 2.1 time: 0.031600 Aug 09 18:03:35.263220 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 435/836] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:35 2022] DELETE /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:35.267566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:35.268178 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 583dd4cf-1ee5-4244-bec6-a9fc62f38403] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:35.274684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.275208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.275641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.276325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.276774 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.277195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.291763 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 HTTP/1.1 Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:35.293311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.295566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '583dd4cf-1ee5-4244-bec6-a9fc62f38403'} Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:35.296695 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. Aug 09 18:03:35.298131 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.299622 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 583dd4cf-1ee5-4244-bec6-a9fc62f38403 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:35.299622 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ee53fb6b-0794-4d93-811d-934b0f60da4e tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403" status: 404 len: 111 microversion: 2.1 time: 0.031624 Aug 09 18:03:35.299622 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 402/837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:35 2022] GET /compute/v2.1/servers/583dd4cf-1ee5-4244-bec6-a9fc62f38403 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:35.303649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:35.304140 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:35.310042 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.310511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.310934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.311633 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.312076 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.312491 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.325560 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 HTTP/1.1 Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:35.327124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.328684 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'ed6b079a-3718-45b9-9707-a39242dc9aa5'} Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:35.329680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.331238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.332810 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:35.332810 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de99b283-7ee7-49d1-9213-05b3fd0b3731 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 404 len: 111 microversion: 2.1 time: 0.028598 Aug 09 18:03:35.332810 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 436/838] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:35 2022] DELETE /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:35.336661 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:35.337262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: ed6b079a-3718-45b9-9707-a39242dc9aa5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:35.343662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.344133 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.344559 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.345234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:35.345674 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:35.346089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:35.360139 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 HTTP/1.1 Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:35.361535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.363161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'ed6b079a-3718-45b9-9707-a39242dc9aa5'} Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:35.364138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. Aug 09 18:03:35.365758 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:35.367255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance ed6b079a-3718-45b9-9707-a39242dc9aa5 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:35.367255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a985d8ae-f41e-4baf-91e6-431927518c55 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5" status: 404 len: 111 microversion: 2.1 time: 0.030052 Aug 09 18:03:35.367255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 403/839] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:35 2022] GET /compute/v2.1/servers/ed6b079a-3718-45b9-9707-a39242dc9aa5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:36.218193 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-894963131", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "networks": [{"uuid": "600e8511-02d9-4fc3-9da1-82e3b5381fea"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:36.271308 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] validate_networks() for [('600e8511-02d9-4fc3-9da1-82e3b5381fea', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:03:36.503905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:36.504399 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:36.510716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.511239 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.511680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.512376 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.512835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.513260 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.526768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 HTTP/1.1 Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:36.528392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.529928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '0cbe1d82-6292-4a15-a16f-d0523a939fe7'} Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:36.530806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.532262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.533658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:36.533658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b17fbd4-0f33-4205-878c-0b30621a388a tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 404 len: 111 microversion: 2.1 time: 0.029999 Aug 09 18:03:36.533658 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 404/840] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:36 2022] DELETE /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:36.538475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:36.539114 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] [instance: 0cbe1d82-6292-4a15-a16f-d0523a939fe7] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:36.550824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.551349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.551915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.552794 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.553250 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.553683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.567994 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] HTTP exception thrown: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Request method failure captured: Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 HTTP/1.1 Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_DAzaZ-Xi1ymmdJ_t2LKcnZjrZnpfr_ZhN8a_ee8LQerGT-x_RwLUB-4_iXcRH5KT8I-c2LmgCkpEMAuEVvNP6ajdr8HwFuX-YQobQDWANRengwaCRTnFw--PKUvMf75X5zBrocXETWOVDY7DYSFvGcaVVwMr1GHoOExsW4OJ4rgU Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:36.569601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9182ab0c79d4b8a9de4c319491ca316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9182ab0c79d4b8a9de4c319491ca316", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f9182ab0c79d4b8a9de4c319491ca316 Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462729456 Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 478a0e3ac431440582d3dca1fe246ac3 Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1462729456-project Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.571199 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '0cbe1d82-6292-4a15-a16f-d0523a939fe7'} Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:36.572059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. Aug 09 18:03:36.573476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.574786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] Returning 404 to user: Instance 0cbe1d82-6292-4a15-a16f-d0523a939fe7 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:36.574786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d3db8f16-3a36-449d-8f19-7614f350ea87 tempest-AttachVolumeNegativeTest-1462729456 tempest-AttachVolumeNegativeTest-1462729456-project] 10.222.0.52 "GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7" status: 404 len: 111 microversion: 2.1 time: 0.036048 Aug 09 18:03:36.574786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 405/841] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:36 2022] GET /compute/v2.1/servers/0cbe1d82-6292-4a15-a16f-d0523a939fe7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:36.677354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:03:36.677958 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:03:36.678405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:03:36.678887 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:03:36.679422 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:03:36.688409 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.688963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.689467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.690260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.690785 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.691301 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.708759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Getting quotas for project fae6073847f2416da72f6c9276da44cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:03:36.712836 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Getting quotas for user 842b7f1ea05f41d0b000f97ee9bf7196 and project fae6073847f2416da72f6c9276da44cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:03:36.724866 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:03:36.727121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:03:36.776533 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1d3386a3-76bc-4543-9231-d6c7a5e2a9ea tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562566 Aug 09 18:03:36.777475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 437/842] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:03:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:03:36.789016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f2259f36-6a7c-4c59-9446-552e990f14d3 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:36.789635 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f2259f36-6a7c-4c59-9446-552e990f14d3 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:36.914292 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:36.916128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:36.924278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.925076 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.925871 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.926880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.927877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.928807 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.944318 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] HTTP exception thrown: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Request method failure captured: Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f HTTP/1.1 Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p--1aZBoRGQoD7CLYvQHdVFpy5xtEspE6DtCjLsHoeEqSfW3ostQg76NkmL74CZ6lKQXRkoAk7zTjm69p5yUUfLK5wB1OaazwVv-nBrb-F5aE7SOFVgiG37wTR0JGZ6uBR76j2-En2Du4NaHrGEj4kJ3Eg_DFelX2Z5j0mNZj1jxnM Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:36.946270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6816355a42d64d5988aff83532ff5888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6816355a42d64d5988aff83532ff5888", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: cb11c04acb4f40cd9d09edf16b11abb0 Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:36.947580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '033ec247-be83-408c-8635-e4cfe8a6212f'} Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:36.948285 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:36.951544 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:36.954762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Returning 404 to user: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:36.955851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c3b2d802-a2f2-4eaa-871b-e92620351c13 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 404 len: 111 microversion: 2.1 time: 0.045922 Aug 09 18:03:36.960017 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 438/843] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:36 2022] DELETE /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:36.965757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:36.968308 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 033ec247-be83-408c-8635-e4cfe8a6212f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:36.974850 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.975664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.976313 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.977340 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:36.977998 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:36.978603 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:36.994741 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] HTTP exception thrown: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Request method failure captured: Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f HTTP/1.1 Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p--1aZBoRGQoD7CLYvQHdVFpy5xtEspE6DtCjLsHoeEqSfW3ostQg76NkmL74CZ6lKQXRkoAk7zTjm69p5yUUfLK5wB1OaazwVv-nBrb-F5aE7SOFVgiG37wTR0JGZ6uBR76j2-En2Du4NaHrGEj4kJ3Eg_DFelX2Z5j0mNZj1jxnM Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:36.997728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6816355a42d64d5988aff83532ff5888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6816355a42d64d5988aff83532ff5888", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: cb11c04acb4f40cd9d09edf16b11abb0 Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:37.001834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '033ec247-be83-408c-8635-e4cfe8a6212f'} Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:37.003210 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. Aug 09 18:03:37.009169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:37.015056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Returning 404 to user: Instance 033ec247-be83-408c-8635-e4cfe8a6212f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:37.015056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c171919a-09ac-4a82-978b-d21ea0814b9c tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f" status: 404 len: 111 microversion: 2.1 time: 0.037701 Aug 09 18:03:37.015056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 439/844] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:36 2022] GET /compute/v2.1/servers/033ec247-be83-408c-8635-e4cfe8a6212f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:37.143236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f2259f36-6a7c-4c59-9446-552e990f14d3 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:37.155132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f2259f36-6a7c-4c59-9446-552e990f14d3 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1218 microversion: 2.1 time: 0.365178 Aug 09 18:03:37.155132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 406/845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:36 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1218 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:38.172774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:38.173516 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:38.180388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:38.181033 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:38.181636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:38.182822 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:38.183190 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:38.183618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:38.192660 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:38.193195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:38.201426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:38.202304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:38.202726 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:38.203539 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:38.204090 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:38.204668 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:38.218916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] HTTP exception thrown: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Request method failure captured: Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 HTTP/1.1 Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p--1aZBoRGQoD7CLYvQHdVFpy5xtEspE6DtCjLsHoeEqSfW3ostQg76NkmL74CZ6lKQXRkoAk7zTjm69p5yUUfLK5wB1OaazwVv-nBrb-F5aE7SOFVgiG37wTR0JGZ6uBR76j2-En2Du4NaHrGEj4kJ3Eg_DFelX2Z5j0mNZj1jxnM Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:38.220742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6816355a42d64d5988aff83532ff5888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6816355a42d64d5988aff83532ff5888", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: cb11c04acb4f40cd9d09edf16b11abb0 Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.222322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '6fc776d4-095b-4bbc-89a9-b99528a089f3'} Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:38.226337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.227856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.229303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Returning 404 to user: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:38.229303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a8c3d133-ed44-4850-b933-69760de3ce2d tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 404 len: 111 microversion: 2.1 time: 0.033553 Aug 09 18:03:38.229303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 407/846] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:38 2022] DELETE /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:38.230472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:38.231625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] [instance: 6fc776d4-095b-4bbc-89a9-b99528a089f3] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:38.238790 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:38.239647 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:38.240098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:38.240801 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:38.241429 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:38.241858 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:38.252979 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:38.258786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] HTTP exception thrown: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Request method failure captured: Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 HTTP/1.1 Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p--1aZBoRGQoD7CLYvQHdVFpy5xtEspE6DtCjLsHoeEqSfW3ostQg76NkmL74CZ6lKQXRkoAk7zTjm69p5yUUfLK5wB1OaazwVv-nBrb-F5aE7SOFVgiG37wTR0JGZ6uBR76j2-En2Du4NaHrGEj4kJ3Eg_DFelX2Z5j0mNZj1jxnM Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:38.260364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6816355a42d64d5988aff83532ff5888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6816355a42d64d5988aff83532ff5888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6816355a42d64d5988aff83532ff5888", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 6816355a42d64d5988aff83532ff5888 Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-862755312 Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: cb11c04acb4f40cd9d09edf16b11abb0 Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-862755312-project Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.262012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '6fc776d4-095b-4bbc-89a9-b99528a089f3'} Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:38.266925 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. Aug 09 18:03:38.268351 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:38.269659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] Returning 404 to user: Instance 6fc776d4-095b-4bbc-89a9-b99528a089f3 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:38.269659 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cc5d2f92-1987-4936-854f-01b1c427b6e3 tempest-AttachVolumeTestJSON-862755312 tempest-AttachVolumeTestJSON-862755312-project] 10.222.0.52 "GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3" status: 404 len: 111 microversion: 2.1 time: 0.035010 Aug 09 18:03:38.269945 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-69d5be8d-56e1-4379-81ec-c5fc6a445757 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1276 microversion: 2.1 time: 0.093878 Aug 09 18:03:38.270044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 408/847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:38 2022] GET /compute/v2.1/servers/6fc776d4-095b-4bbc-89a9-b99528a089f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:38.270143 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 440/848] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:38 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:39.284280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:39.285491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:39.292516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:39.293240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:39.294548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:39.295453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:39.296068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:39.296654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:39.544805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:39.557066 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-45f76ed1-993a-45dc-bf77-78e15477ce21 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.276615 Aug 09 18:03:39.562524 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 409/849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:39 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:40.584218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:40.585599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:40.599373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:40.600473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:40.601143 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:40.602354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:40.603075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:40.603722 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:40.703270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-25bcdd8a-5856-47e0-9356-8ca197159c0b req-ddb0d532-6f55-47cf-ad77-9e57ddd22d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4d387b-1915-4ec1-bc13-9f65d7a5a93f", "tag": "34b0db6b-2f98-454b-bda7-bb370eb64444"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:40.731591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-25bcdd8a-5856-47e0-9356-8ca197159c0b req-ddb0d532-6f55-47cf-ad77-9e57ddd22d32 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:40.732959 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-25bcdd8a-5856-47e0-9356-8ca197159c0b req-ddb0d532-6f55-47cf-ad77-9e57ddd22d32 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:40.734843 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-25bcdd8a-5856-47e0-9356-8ca197159c0b req-ddb0d532-6f55-47cf-ad77-9e57ddd22d32 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:40.765579 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-25bcdd8a-5856-47e0-9356-8ca197159c0b req-ddb0d532-6f55-47cf-ad77-9e57ddd22d32 service nova] Creating event network-changed:34b0db6b-2f98-454b-bda7-bb370eb64444 for instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f on hv-cinder-83608 Aug 09 18:03:40.800876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-25bcdd8a-5856-47e0-9356-8ca197159c0b req-ddb0d532-6f55-47cf-ad77-9e57ddd22d32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100411 Aug 09 18:03:40.802408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 410/850] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:03:40.962250 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:40.974185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a5306000-40ca-4615-8048-a69099fe0f5c tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.393567 Aug 09 18:03:40.976726 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 441/851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:40 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:42.005503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:42.007344 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:42.014861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:42.015634 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:42.016170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:42.016964 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:42.017631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:42.018268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:42.312096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:42.321149 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f8b0d721-0f01-4e2b-8cfc-9958ab85b0e7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.322330 Aug 09 18:03:42.322166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 411/852] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:41 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:43.342791 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:43.343445 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:43.349931 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:43.350494 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:43.351051 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:43.351822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:43.352489 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:43.353018 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:43.444893 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4267080e-9773-4317-b44c-e90ba8fbac47 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Action: 'create', calling method: .version_select at 0x7f8c0b0d0e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2031223911", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:43.502875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:43.511006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-200202a1-5062-4058-be01-612b654aed5f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.172984 Aug 09 18:03:43.511582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 412/853] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:43 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:43.865847 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4267080e-9773-4317-b44c-e90ba8fbac47 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.563282 Aug 09 18:03:43.867047 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 442/854] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 9 18:03:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 565 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 18:03:43.901628 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fe00732b-8cbe-47df-991b-3de478ee1974 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Calling method '.version_select at 0x7f8c067b2430>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:43.970565 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fe00732b-8cbe-47df-991b-3de478ee1974 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552" status: 200 len: 353 microversion: 2.1 time: 0.091053 Aug 09 18:03:43.971624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 413/855] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 18:03:43 2022] GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:44.534057 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:44.534817 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:44.542414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:44.543109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:44.544138 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:44.544872 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:44.545326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:44.545751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:44.697802 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:44.707462 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9a5a136b-d643-4d6c-a03f-1ecd59cfacf0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.177605 Aug 09 18:03:44.708377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 443/856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:44 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:44.986323 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f147a588-2923-4b86-8032-70cb089126e2 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Calling method '.version_select at 0x7f8c0679de50>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:45.037042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f147a588-2923-4b86-8032-70cb089126e2 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552" status: 200 len: 354 microversion: 2.1 time: 0.054747 Aug 09 18:03:45.037685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 414/857] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 18:03:44 2022] GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:45.049896 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a2cbafa7-985c-42d8-84ed-5afdeb22352e tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Calling method '.version_select at 0x7f8c06a25ee0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:45.101975 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a2cbafa7-985c-42d8-84ed-5afdeb22352e tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552" status: 200 len: 354 microversion: 2.1 time: 0.055946 Aug 09 18:03:45.102545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 444/858] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 18:03:45 2022] GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:45.116863 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7d3ed8f5-ec0d-463c-9e22-1cf58c33ed07 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Calling method '.version_select at 0x7f8c0678eaf0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:45.184697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7d3ed8f5-ec0d-463c-9e22-1cf58c33ed07 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552" status: 202 len: 0 microversion: 2.1 time: 0.070959 Aug 09 18:03:45.185259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 415/859] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 18:03:45 2022] DELETE /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:03:45.193555 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-055158a5-63d3-4bea-9400-c8916b031a9e tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Calling method '.version_select at 0x7f8c0b0bf430>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:45.247604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-055158a5-63d3-4bea-9400-c8916b031a9e tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552" status: 200 len: 353 microversion: 2.1 time: 0.056890 Aug 09 18:03:45.248294 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 445/860] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 18:03:45 2022] GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:45.729972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:45.730586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:45.736717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:45.737278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:45.737784 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:45.738566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:45.739124 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:45.739642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:45.895262 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:45.903518 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c0cb9d2d-2017-4477-a6ea-2797ba476670 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.177520 Aug 09 18:03:45.904020 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 416/861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:45 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:46.262512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e65ad36-f4a3-4823-8497-4a56ed1d74a1 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Calling method '.version_select at 0x7f8c0b0e8160>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:46.294015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-9e65ad36-f4a3-4823-8497-4a56ed1d74a1 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] HTTP exception thrown: Volume badb8007-f54c-4f9e-90fd-8ac2b272e552 could not be found. Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e65ad36-f4a3-4823-8497-4a56ed1d74a1 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Request method failure captured: Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552 HTTP/1.1 Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qF_PtrO605o8FLBwBXR7YjY7mxc8vF5oCWpl7ijzVwTTjjZ4qIbtYRQVtxH19yWV_KeIbM_ijzWxonCp3dgy-zjAngfpzqFt707zPRK_Gwi8tuo-fNvTLzGvIYPcTFim5xuo3sK_fMA51SfxMx73NGEFlkt-CbcCedvUpt7ryKcKi4 Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 8bc6913abd5546fe9158612fe56a5f1c Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesGetTestJSON-1313368933 Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:46.297100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bc6913abd5546fe9158612fe56a5f1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bc6913abd5546fe9158612fe56a5f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bc6913abd5546fe9158612fe56a5f1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bc6913abd5546fe9158612fe56a5f1c", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesGetTestJSON-1313368933 Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 8bc6913abd5546fe9158612fe56a5f1c Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesGetTestJSON-1313368933 Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesGetTestJSON-1313368933-project Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 5b2b570130da45aaa2ed28340bd6cd96 Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesGetTestJSON-1313368933-project Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Volume badb8007-f54c-4f9e-90fd-8ac2b272e552 could not be found. Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'badb8007-f54c-4f9e-90fd-8ac2b272e552'} Aug 09 18:03:46.298465 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume badb8007-f54c-4f9e-90fd-8ac2b272e552 could not be found. (HTTP 404) (Request-ID: req-823c5be6-f87f-4d90-984c-4c69c7615c48) Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:46.299401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:03:46.300669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume badb8007-f54c-4f9e-90fd-8ac2b272e552 could not be found. Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:03:46.302153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume badb8007-f54c-4f9e-90fd-8ac2b272e552 could not be found. Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume badb8007-f54c-4f9e-90fd-8ac2b272e552 could not be found. Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e65ad36-f4a3-4823-8497-4a56ed1d74a1 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] Returning 404 to user: Volume badb8007-f54c-4f9e-90fd-8ac2b272e552 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9e65ad36-f4a3-4823-8497-4a56ed1d74a1 tempest-VolumesGetTestJSON-1313368933 tempest-VolumesGetTestJSON-1313368933-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552" status: 404 len: 109 microversion: 2.1 time: 0.040758 Aug 09 18:03:46.304607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 446/862] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 18:03:46 2022] GET /compute/v2.1/os-volumes/badb8007-f54c-4f9e-90fd-8ac2b272e552 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:03:46.364918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c2dfd6f1-e01b-40b9-a1d1-6ded684f8438 req-b95b371b-f257-4d77-8fbf-f733727798b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4d387b-1915-4ec1-bc13-9f65d7a5a93f", "name": "network-vif-plugged", "status": "completed", "tag": "34b0db6b-2f98-454b-bda7-bb370eb64444"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:46.379802 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c2dfd6f1-e01b-40b9-a1d1-6ded684f8438 req-b95b371b-f257-4d77-8fbf-f733727798b5 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:46.380622 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c2dfd6f1-e01b-40b9-a1d1-6ded684f8438 req-b95b371b-f257-4d77-8fbf-f733727798b5 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:46.381452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c2dfd6f1-e01b-40b9-a1d1-6ded684f8438 req-b95b371b-f257-4d77-8fbf-f733727798b5 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:46.395515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c2dfd6f1-e01b-40b9-a1d1-6ded684f8438 req-b95b371b-f257-4d77-8fbf-f733727798b5 service nova] Creating event network-vif-plugged:34b0db6b-2f98-454b-bda7-bb370eb64444 for instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f on hv-cinder-83608 Aug 09 18:03:46.406514 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c2dfd6f1-e01b-40b9-a1d1-6ded684f8438 req-b95b371b-f257-4d77-8fbf-f733727798b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049250 Aug 09 18:03:46.407841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 417/863] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:46.731588 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:46.732808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:46.737611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:46.739955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:46.760185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:46.760733 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:46.761386 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:46.762942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:46.763421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:46.763838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:46.802941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4be476d5-a013-49f7-aa7f-5db2d77db42b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072892 Aug 09 18:03:46.803551 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 447/864] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 9 18:03:46 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:46.892192 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:46.892910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:46.899701 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:46.900252 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:46.900754 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:46.901536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:46.902054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:46.902582 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:46.924710 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:46.925355 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:46.931910 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:46.932588 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:46.933295 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:46.934740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:46.935378 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:46.935985 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:46.967426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:03:46.986092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:47.066293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-94b54449-776b-464c-9ac7-06f61f064e5d tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 204 len: 0 microversion: 2.20 time: 0.179166 Aug 09 18:03:47.067590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 418/865] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 9 18:03:46 2022] DELETE /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:03:47.079853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:47.080762 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:47.091214 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:47.091783 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:47.092239 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:47.093174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:47.093831 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:47.094270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:47.140291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:47.148051 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9304ce95-d08c-4c36-b677-7b670f9c12c7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.227377 Aug 09 18:03:47.148625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 448/866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:46 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:47.149624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:47.284410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:47.298318 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:47.301189 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:47.303142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-16a0ecd6-a019-494c-9c4b-4633293cdea0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.230475 Aug 09 18:03:47.304138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 419/867] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:03:47 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:03:48.170236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:48.171788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:48.178379 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:48.178873 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:48.179365 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:48.180069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:48.180525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:48.180948 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:48.225714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76147345-7b1c-442d-b4ab-f7578403e13c tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Action: 'create', calling method: .version_select at 0x7f8c0b0e89d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1589169863", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76147345-7b1c-442d-b4ab-f7578403e13c tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Request method failure captured: Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 122 Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qGDXU0-Tc24-3Kesy5p8PJuhfR6UQcY5CthdntJzxH-H-TBBvfi7glGqNr4HosqRcpDcZXBwY0fGjcX0NND6gwU5032TKuD-oRYQwcWTLUgINXJ1eqcrctSoTrP9l6KHlyuFFaPN3VcYcEpgRhDRUB2H8pEaurqHbBMx9wwRpgZmuQ Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:48.242763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea9e5e5acd7841c5920090a69b18937e", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: bc8aa62439234677a180f9a1d8a94f55 Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1589169863", "metadata": {"Type": "work"}}} Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: Aug 09 18:03:48.244225 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1589169863', 'metadata': {'Type': 'work'}}}} Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:48.250101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:03:48.251825 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:03:48.253213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:03:48.253213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.253213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76147345-7b1c-442d-b4ab-f7578403e13c tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:48.253213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-76147345-7b1c-442d-b4ab-f7578403e13c tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.161368 Aug 09 18:03:48.253213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 449/868] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 9 18:03:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:03:48.257769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9a165675-94c9-4c2a-922f-ab60853d3091 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Action: 'create', calling method: .version_select at 0x7f8c0b07c1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1820739604", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9a165675-94c9-4c2a-922f-ab60853d3091 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Request method failure captured: Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 120 Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qGDXU0-Tc24-3Kesy5p8PJuhfR6UQcY5CthdntJzxH-H-TBBvfi7glGqNr4HosqRcpDcZXBwY0fGjcX0NND6gwU5032TKuD-oRYQwcWTLUgINXJ1eqcrctSoTrP9l6KHlyuFFaPN3VcYcEpgRhDRUB2H8pEaurqHbBMx9wwRpgZmuQ Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:48.263012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea9e5e5acd7841c5920090a69b18937e", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: bc8aa62439234677a180f9a1d8a94f55 Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1820739604", "metadata": {"Type": "work"}}} Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: Aug 09 18:03:48.264839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1820739604', 'metadata': {'Type': 'work'}}}} Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi '0' Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:48.265718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:03:48.267195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:03:48.269273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:03:48.269273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.269273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9a165675-94c9-4c2a-922f-ab60853d3091 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:48.269273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9a165675-94c9-4c2a-922f-ab60853d3091 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013223 Aug 09 18:03:48.269273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 450/869] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 9 18:03:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:03:48.276608 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fb4b3fd6-493c-41be-9c4d-7b788975c9c9 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Action: 'create', calling method: .version_select at 0x7f8c0b0bf310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1277680421", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fb4b3fd6-493c-41be-9c4d-7b788975c9c9 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Request method failure captured: Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 119 Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qGDXU0-Tc24-3Kesy5p8PJuhfR6UQcY5CthdntJzxH-H-TBBvfi7glGqNr4HosqRcpDcZXBwY0fGjcX0NND6gwU5032TKuD-oRYQwcWTLUgINXJ1eqcrctSoTrP9l6KHlyuFFaPN3VcYcEpgRhDRUB2H8pEaurqHbBMx9wwRpgZmuQ Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:48.281072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea9e5e5acd7841c5920090a69b18937e", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: bc8aa62439234677a180f9a1d8a94f55 Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1277680421", "metadata": {"Type": "work"}}} Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: Aug 09 18:03:48.282563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1277680421', 'metadata': {'Type': 'work'}}}} Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi '' Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:48.283565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:03:48.285015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:03:48.286279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:03:48.286279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.286279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fb4b3fd6-493c-41be-9c4d-7b788975c9c9 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:48.286279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fb4b3fd6-493c-41be-9c4d-7b788975c9c9 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010942 Aug 09 18:03:48.286279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 451/870] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 9 18:03:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:03:48.292098 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a463616b-5ee5-4e98-8a30-bd352505c87e tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Calling method '.version_select at 0x7f8c0b07c3a0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:48.325921 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-a463616b-5ee5-4e98-8a30-bd352505c87e tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] HTTP exception thrown: Volume tempest-invalid-316942835 could not be found. Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a463616b-5ee5-4e98-8a30-bd352505c87e tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Request method failure captured: Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-316942835 HTTP/1.1 Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qGDXU0-Tc24-3Kesy5p8PJuhfR6UQcY5CthdntJzxH-H-TBBvfi7glGqNr4HosqRcpDcZXBwY0fGjcX0NND6gwU5032TKuD-oRYQwcWTLUgINXJ1eqcrctSoTrP9l6KHlyuFFaPN3VcYcEpgRhDRUB2H8pEaurqHbBMx9wwRpgZmuQ Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:48.328886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea9e5e5acd7841c5920090a69b18937e", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: bc8aa62439234677a180f9a1d8a94f55 Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Volume tempest-invalid-316942835 could not be found. Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'tempest-invalid-316942835'} Aug 09 18:03:48.330358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-316942835 could not be found. (HTTP 404) (Request-ID: req-8ca9b1b7-4fb4-4fd1-8f53-3b145c78bec1) Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.331269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:03:48.332714 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-316942835 could not be found. Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:48.334032 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-316942835 could not be found. Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-316942835 could not be found. Aug 09 18:03:48.335486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.337341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a463616b-5ee5-4e98-8a30-bd352505c87e tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Returning 404 to user: Volume tempest-invalid-316942835 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:48.338377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a463616b-5ee5-4e98-8a30-bd352505c87e tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-316942835" status: 404 len: 98 microversion: 2.1 time: 0.050196 Aug 09 18:03:48.344954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 452/871] 10.222.0.52 () {58 vars in 1215 bytes} [Tue Aug 9 18:03:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-316942835 => generated 98 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 18:03:48.349989 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:48.350743 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:48.351729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:48.357963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:48.358771 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:48.359234 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:48.360157 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:48.360664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:48.361094 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:48.362614 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e69249f9-616a-465d-8b20-35f5c3fd32cf tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1318 microversion: 2.1 time: 0.196617 Aug 09 18:03:48.363596 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 420/872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:48 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:48.368753 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7b7dd567-9682-45b5-93d0-a9d491444717 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003903 Aug 09 18:03:48.369377 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 421/873] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Aug 9 18:03:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 18:03:48.382356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d82114b0-ef5c-4fb3-97ea-78a1b8f6dbdb tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005621 Aug 09 18:03:48.383272 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 422/874] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Aug 9 18:03:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 09 18:03:48.393415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f04d453b-a042-4628-8169-93a159c3e50b tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Calling method '.version_select at 0x7f8c06725940>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:48.427274 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-f04d453b-a042-4628-8169-93a159c3e50b tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] HTTP exception thrown: Volume c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 could not be found. Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f04d453b-a042-4628-8169-93a159c3e50b tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Request method failure captured: Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/os-volumes/c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 HTTP/1.1 Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qGDXU0-Tc24-3Kesy5p8PJuhfR6UQcY5CthdntJzxH-H-TBBvfi7glGqNr4HosqRcpDcZXBwY0fGjcX0NND6gwU5032TKuD-oRYQwcWTLUgINXJ1eqcrctSoTrP9l6KHlyuFFaPN3VcYcEpgRhDRUB2H8pEaurqHbBMx9wwRpgZmuQ Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:48.429374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea9e5e5acd7841c5920090a69b18937e", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: bc8aa62439234677a180f9a1d8a94f55 Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Volume c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 could not be found. Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6'} Aug 09 18:03:48.432335 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 could not be found. (HTTP 404) (Request-ID: req-a1f7da6b-bb8b-4db8-bdc8-28141ce2ec65) Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.434439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:03:48.436845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 could not be found. Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:03:48.439294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 could not be found. Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 could not be found. Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f04d453b-a042-4628-8169-93a159c3e50b tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Returning 404 to user: Volume c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f04d453b-a042-4628-8169-93a159c3e50b tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6" status: 404 len: 109 microversion: 2.1 time: 0.041488 Aug 09 18:03:48.441983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 423/875] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 9 18:03:48 2022] DELETE /compute/v2.1/os-volumes/c389c2ab-fd0d-4b1a-bb8d-61c3e3d7abe6 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:48.444107 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a975c361-4216-4227-8dcf-ace030f006e5 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Calling method '.version_select at 0x7f8c067b2280>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:48.474023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-a975c361-4216-4227-8dcf-ace030f006e5 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] HTTP exception thrown: Volume cfc43bef-3a07-4f30-9393-9b664e4a77ac could not be found. Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a975c361-4216-4227-8dcf-ace030f006e5 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Request method failure captured: Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-volumes/cfc43bef-3a07-4f30-9393-9b664e4a77ac HTTP/1.1 Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qGDXU0-Tc24-3Kesy5p8PJuhfR6UQcY5CthdntJzxH-H-TBBvfi7glGqNr4HosqRcpDcZXBwY0fGjcX0NND6gwU5032TKuD-oRYQwcWTLUgINXJ1eqcrctSoTrP9l6KHlyuFFaPN3VcYcEpgRhDRUB2H8pEaurqHbBMx9wwRpgZmuQ Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:48.476004 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea9e5e5acd7841c5920090a69b18937e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea9e5e5acd7841c5920090a69b18937e", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: ea9e5e5acd7841c5920090a69b18937e Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-323300445 Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: bc8aa62439234677a180f9a1d8a94f55 Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-323300445-project Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Volume cfc43bef-3a07-4f30-9393-9b664e4a77ac could not be found. Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'cfc43bef-3a07-4f30-9393-9b664e4a77ac'} Aug 09 18:03:48.477275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cfc43bef-3a07-4f30-9393-9b664e4a77ac could not be found. (HTTP 404) (Request-ID: req-7b8a83b1-f9e8-4fcf-bab5-2e03b6d801ba) Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.478091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:03:48.479270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cfc43bef-3a07-4f30-9393-9b664e4a77ac could not be found. Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:03:48.488927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cfc43bef-3a07-4f30-9393-9b664e4a77ac could not be found. Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cfc43bef-3a07-4f30-9393-9b664e4a77ac could not be found. Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a975c361-4216-4227-8dcf-ace030f006e5 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] Returning 404 to user: Volume cfc43bef-3a07-4f30-9393-9b664e4a77ac could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a975c361-4216-4227-8dcf-ace030f006e5 tempest-VolumesNegativeTest-323300445 tempest-VolumesNegativeTest-323300445-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cfc43bef-3a07-4f30-9393-9b664e4a77ac" status: 404 len: 109 microversion: 2.1 time: 0.040332 Aug 09 18:03:48.490599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 424/876] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 9 18:03:48 2022] GET /compute/v2.1/os-volumes/cfc43bef-3a07-4f30-9393-9b664e4a77ac => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:48.526786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:48.531291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:48.536812 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:48.538900 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:48.540169 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fc50b5d-544c-4420-8774-8fef720281a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.194173 Aug 09 18:03:48.541136 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 453/877] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:03:48 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:03:49.383913 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:49.384539 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:49.391588 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:49.392139 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:49.392812 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:49.393502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:49.393959 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:49.394385 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:49.550830 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:49.558686 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8f96b0c6-83c1-4344-93dd-b52d846577a9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1506 microversion: 2.1 time: 0.179115 Aug 09 18:03:49.571755 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 425/878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:49 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:49.581936 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:49.582610 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:49.590040 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:49.591255 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:49.591948 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:49.592750 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:49.593219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:49.593649 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:49.758589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:49.781812 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:49.783838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:49.786460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1b2c6f41-e488-43fb-a09f-d7175359ae3c tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1724 microversion: 2.20 time: 0.221038 Aug 09 18:03:49.787326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 454/879] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:03:49 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:03:50.587172 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-441b1b4f-fb19-4d9d-bbcf-6557e2db42d1 req-c8f49de7-fdf2-43d7-8fdf-452050339f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6e12fe-4b50-43ad-a12e-49a0575a710a", "name": "network-vif-deleted", "tag": "01b7a043-db0a-49c0-9549-758464cbc252"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:50.599563 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-441b1b4f-fb19-4d9d-bbcf-6557e2db42d1 req-c8f49de7-fdf2-43d7-8fdf-452050339f29 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:50.600490 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-441b1b4f-fb19-4d9d-bbcf-6557e2db42d1 req-c8f49de7-fdf2-43d7-8fdf-452050339f29 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:50.601217 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-441b1b4f-fb19-4d9d-bbcf-6557e2db42d1 req-c8f49de7-fdf2-43d7-8fdf-452050339f29 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:50.616185 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-441b1b4f-fb19-4d9d-bbcf-6557e2db42d1 req-c8f49de7-fdf2-43d7-8fdf-452050339f29 service nova] Creating event network-vif-deleted:01b7a043-db0a-49c0-9549-758464cbc252 for instance ff6e12fe-4b50-43ad-a12e-49a0575a710a on hv-cinder-83608 Aug 09 18:03:50.624769 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-441b1b4f-fb19-4d9d-bbcf-6557e2db42d1 req-c8f49de7-fdf2-43d7-8fdf-452050339f29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042103 Aug 09 18:03:50.627881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 426/880] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:50.839121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:50.839761 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:50.850679 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:50.851636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:50.852313 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:50.853961 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:50.855487 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:50.856739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:50.900277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:50.900767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:50.901186 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:50.901632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lazy-loading 'fault' on Instance uuid ff6e12fe-4b50-43ad-a12e-49a0575a710a {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:03:50.945930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:50.953973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:50.955622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18bf10b172e7450a9b618683643ed48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b320e561ec5450682ed979963c392a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:50.956757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-db45b472-d86a-4e3f-9ef0-4ea3f01cee7b tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 200 len: 1371 microversion: 2.20 time: 0.134290 Aug 09 18:03:50.957304 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 455/881] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:03:50 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 1371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:03:51.986013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:51.986776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:51.993448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:51.994024 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:51.994528 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:51.995328 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:51.996032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:51.996729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:52.017922 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] HTTP exception thrown: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Request method failure captured: Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a HTTP/1.1 Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_JLzgDxXS3UAUeldXlOM3_Z3f_nBnNqREJABXNNV4894RcJBEPeLt8negLr_JNBWdKuzTS4pHMp7p8H_SZ1qmhQyExL5t4KUfrPgESaVJ97MMt-6eT7iWay0GQMXaOnoKncEbD-cbRM-IgMxBc195K_ikyY0IarZHDUR27m2hrPfI Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:52.020840 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b320e561ec5450682ed979963c392a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b320e561ec5450682ed979963c392a0", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 18bf10b172e7450a9b618683643ed48e Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:52.022918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'ff6e12fe-4b50-43ad-a12e-49a0575a710a'} Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:52.023704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:52.025644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:52.029147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Returning 404 to user: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:52.030083 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a8303287-dd71-4fa4-b892-f937a33905a0 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 404 len: 111 microversion: 2.20 time: 0.049105 Aug 09 18:03:52.030577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 427/882] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:03:51 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:03:52.040189 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eccb7ad2-bad0-4a7c-9241-ae97809b2a3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '.version_select at 0x7f8c0b02f4c0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:52.082283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eccb7ad2-bad0-4a7c-9241-ae97809b2a3f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-704370108" status: 204 len: 0 microversion: 2.20 time: 0.046589 Aug 09 18:03:52.082848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 456/883] 10.222.0.52 () {60 vars in 1259 bytes} [Tue Aug 9 18:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-704370108 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:03:54.306092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:54.306679 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:54.318234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:54.319165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:54.319850 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:54.320591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:54.321060 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:54.321491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:54.341687 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] HTTP exception thrown: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Request method failure captured: Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a HTTP/1.1 Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_JLzgDxXS3UAUeldXlOM3_Z3f_nBnNqREJABXNNV4894RcJBEPeLt8negLr_JNBWdKuzTS4pHMp7p8H_SZ1qmhQyExL5t4KUfrPgESaVJ97MMt-6eT7iWay0GQMXaOnoKncEbD-cbRM-IgMxBc195K_ikyY0IarZHDUR27m2hrPfI Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:54.343856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b320e561ec5450682ed979963c392a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b320e561ec5450682ed979963c392a0", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 18bf10b172e7450a9b618683643ed48e Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.345631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'ff6e12fe-4b50-43ad-a12e-49a0575a710a'} Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:54.346568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.348161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.350731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Returning 404 to user: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:54.351822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6feee0e8-097a-4d13-812c-92468c0a7b82 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 404 len: 111 microversion: 2.20 time: 0.049674 Aug 09 18:03:54.352875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 428/884] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 9 18:03:54 2022] DELETE /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:03:54.361806 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:54.362565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ff6e12fe-4b50-43ad-a12e-49a0575a710a] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:54.366436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:54.377682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:54.378685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:54.379550 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:54.381341 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:54.382010 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:54.382775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:54.424590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] HTTP exception thrown: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Request method failure captured: Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a HTTP/1.1 Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_JLzgDxXS3UAUeldXlOM3_Z3f_nBnNqREJABXNNV4894RcJBEPeLt8negLr_JNBWdKuzTS4pHMp7p8H_SZ1qmhQyExL5t4KUfrPgESaVJ97MMt-6eT7iWay0GQMXaOnoKncEbD-cbRM-IgMxBc195K_ikyY0IarZHDUR27m2hrPfI Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:54.426211 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b320e561ec5450682ed979963c392a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b320e561ec5450682ed979963c392a0", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 18bf10b172e7450a9b618683643ed48e Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.427798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'ff6e12fe-4b50-43ad-a12e-49a0575a710a'} Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:54.428568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. Aug 09 18:03:54.432556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:54.434468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Returning 404 to user: Instance ff6e12fe-4b50-43ad-a12e-49a0575a710a could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:54.434468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7e971730-9479-4b69-881d-84413cc4d8bf tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a" status: 404 len: 111 microversion: 2.20 time: 0.070306 Aug 09 18:03:54.434468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 457/885] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:03:54 2022] GET /compute/v2.1/servers/ff6e12fe-4b50-43ad-a12e-49a0575a710a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:03:55.713999 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:55.714651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:55.724573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:55.725080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:55.725693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:55.726655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:55.727145 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:55.727760 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:55.756487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] HTTP exception thrown: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Request method failure captured: Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 HTTP/1.1 Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8p_JLzgDxXS3UAUeldXlOM3_Z3f_nBnNqREJABXNNV4894RcJBEPeLt8negLr_JNBWdKuzTS4pHMp7p8H_SZ1qmhQyExL5t4KUfrPgESaVJ97MMt-6eT7iWay0GQMXaOnoKncEbD-cbRM-IgMxBc195K_ikyY0IarZHDUR27m2hrPfI Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:03:55.758072 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b320e561ec5450682ed979963c392a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b320e561ec5450682ed979963c392a0", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 18bf10b172e7450a9b618683643ed48e Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.759776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'ffe8c172-bab3-4a24-b716-1b536176ef81'} Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:55.760599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.762227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.763842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Returning 404 to user: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:55.763842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-09e15f32-3e3b-4ce7-99da-01c393a76b0f tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 404 len: 111 microversion: 2.20 time: 0.050244 Aug 09 18:03:55.763842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 429/886] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 9 18:03:55 2022] DELETE /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:03:55.769047 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:55.769789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] [instance: ffe8c172-bab3-4a24-b716-1b536176ef81] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:55.778963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:55.779526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:55.784209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:55.785477 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:55.787556 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:55.788038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:55.804823 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] HTTP exception thrown: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Request method failure captured: Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 HTTP/1.1 Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8p_JLzgDxXS3UAUeldXlOM3_Z3f_nBnNqREJABXNNV4894RcJBEPeLt8negLr_JNBWdKuzTS4pHMp7p8H_SZ1qmhQyExL5t4KUfrPgESaVJ97MMt-6eT7iWay0GQMXaOnoKncEbD-cbRM-IgMxBc195K_ikyY0IarZHDUR27m2hrPfI Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:03:55.806393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b320e561ec5450682ed979963c392a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b320e561ec5450682ed979963c392a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b320e561ec5450682ed979963c392a0", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 3b320e561ec5450682ed979963c392a0 Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717489801 Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 18bf10b172e7450a9b618683643ed48e Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717489801-project Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.808279 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'ffe8c172-bab3-4a24-b716-1b536176ef81'} Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:55.809685 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. Aug 09 18:03:55.812203 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:03:55.813467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] Returning 404 to user: Instance ffe8c172-bab3-4a24-b716-1b536176ef81 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:55.813467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8c871ccd-978a-4a5f-90fc-bbea75f34561 tempest-AttachVolumeShelveTestJSON-1717489801 tempest-AttachVolumeShelveTestJSON-1717489801-project] 10.222.0.52 "GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81" status: 404 len: 111 microversion: 2.20 time: 0.043346 Aug 09 18:03:55.813467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 458/887] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 9 18:03:55 2022] GET /compute/v2.1/servers/ffe8c172-bab3-4a24-b716-1b536176ef81 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:04:07.553299 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c93aab7e-9fd2-412b-a8f5-ef212c4bbb20", "device": "/dev/sdb"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:04:07.556225 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:07.559430 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:04:07.560070 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:04:07.566927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:07.567462 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:07.567896 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:07.568589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:07.569037 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:07.569456 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:07.873029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7ae77dbb-b26b-44d9-8b3b-0bfe1189e2b4 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "POST /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323133 Aug 09 18:04:07.874185 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 430/888] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:04:07 2022] POST /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:04:40.233954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:40.234484 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:40.237014 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:04:40.237656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=18 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:04:40.243313 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:40.243796 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:40.244231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:40.244928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:40.245386 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:40.245811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:40.329761 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lazy-loading 'services' on Instance uuid 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:04:40.406962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-57a4421d-5951-482d-b74c-a658e2332a06 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f/os-volume_attachments/c93aab7e-9fd2-412b-a8f5-ef212c4bbb20" status: 202 len: 0 microversion: 2.1 time: 0.175671 Aug 09 18:04:40.408187 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 459/889] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:04:40 2022] DELETE /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f/os-volume_attachments/c93aab7e-9fd2-412b-a8f5-ef212c4bbb20 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:04:44.744845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:04:44.745763 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:04:44.750261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:44.750947 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:44.759784 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:44.760369 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:44.760926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:44.761842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:44.762349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:44.762782 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:44.795505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:04:44.885585 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2383b680-ff38-4dfb-bdcf-3c9496378c6f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 204 len: 0 microversion: 2.1 time: 0.141992 Aug 09 18:04:44.886229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 431/890] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:04:44 2022] DELETE /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:04:44.901781 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:44.906790 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:44.914188 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:44.914721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:44.915339 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:44.916178 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:44.916923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:44.917343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:45.079683 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:04:45.089501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d3d3a747-db0a-481b-aac9-185db603431f tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1512 microversion: 2.1 time: 0.195398 Aug 09 18:04:45.090088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 460/891] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:04:44 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:04:46.111635 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:46.112341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:46.118904 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:46.119450 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:46.120038 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:46.120584 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:46.121040 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:46.121466 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:46.254642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:04:46.262428 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a41e35f9-704d-42bc-967c-500f61410811 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1512 microversion: 2.1 time: 0.155006 Aug 09 18:04:46.263021 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 432/892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:04:46 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:04:47.284114 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:47.284654 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:47.291462 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:47.291934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:47.292460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:47.293319 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:47.293766 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:47.294182 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:47.429342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:04:47.436999 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93303730-04b8-4a75-a3f3-0b38ce88d320 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1512 microversion: 2.1 time: 0.156783 Aug 09 18:04:47.437575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 461/893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:04:47 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:04:47.936801 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-59334f02-d78a-4c49-9e1c-51c40a91bd9c req-4571a709-fbfb-494f-945e-20ad2abd7ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4d387b-1915-4ec1-bc13-9f65d7a5a93f", "name": "network-vif-deleted", "tag": "34b0db6b-2f98-454b-bda7-bb370eb64444"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:04:47.948174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-59334f02-d78a-4c49-9e1c-51c40a91bd9c req-4571a709-fbfb-494f-945e-20ad2abd7ddc service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:47.948678 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-59334f02-d78a-4c49-9e1c-51c40a91bd9c req-4571a709-fbfb-494f-945e-20ad2abd7ddc service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:47.949111 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-59334f02-d78a-4c49-9e1c-51c40a91bd9c req-4571a709-fbfb-494f-945e-20ad2abd7ddc service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:47.963754 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-59334f02-d78a-4c49-9e1c-51c40a91bd9c req-4571a709-fbfb-494f-945e-20ad2abd7ddc service nova] Creating event network-vif-deleted:34b0db6b-2f98-454b-bda7-bb370eb64444 for instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f on hv-cinder-83608 Aug 09 18:04:47.968591 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-59334f02-d78a-4c49-9e1c-51c40a91bd9c req-4571a709-fbfb-494f-945e-20ad2abd7ddc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035489 Aug 09 18:04:47.969186 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 433/894] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:04:48.459762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:48.460445 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:48.466920 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:48.467215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:48.467652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:48.468351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:48.468805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:48.469233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:48.504100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:48.504585 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:48.505013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:48.505452 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lazy-loading 'fault' on Instance uuid 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:04:48.548520 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:04:48.557057 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c4ec1368-7f82-43e9-99ed-ad1157842692 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1308 microversion: 2.1 time: 0.103030 Aug 09 18:04:48.557638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 462/895] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:04:48 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:04:49.579990 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:49.580714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:49.587410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:49.587896 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:49.588332 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:49.589054 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:49.589510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:49.589936 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:49.621330 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:49.621813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:49.622250 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:49.622697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lazy-loading 'fault' on Instance uuid 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:04:49.663915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:04:49.671470 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-59e0a7e8-1ff3-47b2-aee4-b8f01f37f1b5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1308 microversion: 2.1 time: 0.095814 Aug 09 18:04:49.672023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 434/896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:04:49 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:04:50.693119 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:50.693727 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:50.700396 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:50.700877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:50.701328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:50.702008 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:50.702457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:50.702881 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:50.738803 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:50.739358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:50.739795 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:50.740249 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lazy-loading 'fault' on Instance uuid 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:04:50.782770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:04:50.790443 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-03fda4a7-2c94-4100-9e06-62c7d4be5460 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 200 len: 1308 microversion: 2.1 time: 0.101767 Aug 09 18:04:50.791295 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 463/897] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:04:50 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:04:51.811680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:04:51.812577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:04:51.819485 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:51.819967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:51.820396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:51.821142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:04:51.821599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:04:51.822143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:04:51.837905 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] HTTP exception thrown: Instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f could not be found. Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Request method failure captured: Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f HTTP/1.1 Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qF2rWI-f4J0x7fAoLRilY6lk79nK1QblawcUicrZYPjahtdGCQM8xFuAXBn6Vfh9YhseBbKW_VeFrLbnQ_LV3kAB08e7wjpWrd9HK44nGBSFkDy03_UQyO4F2HavlMru2MIraBa7JQoI-BsFUWrizWVfFWjOHyPRXGa-7NK38Qzndk Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: fae6073847f2416da72f6c9276da44cf Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1079152397 Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:04:51.839757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fae6073847f2416da72f6c9276da44cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fae6073847f2416da72f6c9276da44cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fae6073847f2416da72f6c9276da44cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fae6073847f2416da72f6c9276da44cf", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotTestJSON-1079152397 Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: fae6073847f2416da72f6c9276da44cf Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1079152397 Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotTestJSON-1079152397-project Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 842b7f1ea05f41d0b000f97ee9bf7196 Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotTestJSON-1079152397-project Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f could not be found. Aug 09 18:04:51.841467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '1e4d387b-1915-4ec1-bc13-9f65d7a5a93f'} Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f could not be found. Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:04:51.845747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f could not be found. Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f could not be found. Aug 09 18:04:51.847268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:04:51.848727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Returning 404 to user: Instance 1e4d387b-1915-4ec1-bc13-9f65d7a5a93f could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:04:51.848727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5fa3e98b-8bf3-479e-bba8-110cf5b83a33 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f" status: 404 len: 111 microversion: 2.1 time: 0.033463 Aug 09 18:04:51.848727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 435/898] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:04:51 2022] GET /compute/v2.1/servers/1e4d387b-1915-4ec1-bc13-9f65d7a5a93f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:05:00.871015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2073426670", "imageRef": "651e26d5-5d5f-4888-977a-689e5e920ea8", "flavorRef": "452", "networks": [{"uuid": "600e8511-02d9-4fc3-9da1-82e3b5381fea"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:00.880940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=14 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:00.881562 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:00.964821 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] validate_networks() for [('600e8511-02d9-4fc3-9da1-82e3b5381fea', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:05:01.507312 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:05:01.508850 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:05:01.509877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:05:01.510467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:05:01.511192 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:05:01.525404 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:01.525883 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:01.526313 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:01.527043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:01.527489 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:01.528351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:01.563345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Getting quotas for project fae6073847f2416da72f6c9276da44cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:05:01.568243 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Getting quotas for user 842b7f1ea05f41d0b000f97ee9bf7196 and project fae6073847f2416da72f6c9276da44cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:05:01.599881 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:05:01.602720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='651e26d5-5d5f-4888-977a-689e5e920ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:05:01.667249 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e987353b-96b7-48c1-8375-7fe5b0c30f70 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800166 Aug 09 18:05:01.671135 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 464/899] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:05:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:05:01.683598 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e8b30fd2-d624-45e2-9500-2942c5e51c71 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:01.684809 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e8b30fd2-d624-45e2-9500-2942c5e51c71 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:01.776956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e8b30fd2-d624-45e2-9500-2942c5e51c71 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:01.789568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e8b30fd2-d624-45e2-9500-2942c5e51c71 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1219 microversion: 2.1 time: 0.111395 Aug 09 18:05:01.790247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 436/900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:01 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:02.814351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:02.817541 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:02.827092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:02.828254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:02.828937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:02.829851 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:02.830745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:02.831472 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:02.914746 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:02.925470 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-40755abe-dadf-424b-897d-8a187a5493c8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1271 microversion: 2.1 time: 0.118256 Aug 09 18:05:02.943924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 465/901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:02 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:03.955492 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:03.957063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:03.960704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:03.971512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:03.972110 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:03.974151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:03.975907 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:03.976673 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:03.977697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:04.073899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:04.081569 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d04c322a-9eee-48b1-b91e-64d980d5b347 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1277 microversion: 2.1 time: 0.131651 Aug 09 18:05:04.083494 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 437/902] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:03 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:05.103898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:05.105296 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:05.117735 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:05.121602 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:05.123298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:05.125769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:05.128054 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:05.132269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:05.241639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b16088c2-b697-4ff1-80f1-ca6caa46e790 req-adcf1b50-c2c1-43d5-95ce-1c144d982d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cced02b-6537-4a96-92d1-128ed63b6ed1", "tag": "6054d191-78ab-4624-8140-5490d83b9f75"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:05.287198 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b16088c2-b697-4ff1-80f1-ca6caa46e790 req-adcf1b50-c2c1-43d5-95ce-1c144d982d45 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:05.287843 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b16088c2-b697-4ff1-80f1-ca6caa46e790 req-adcf1b50-c2c1-43d5-95ce-1c144d982d45 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:05.288460 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b16088c2-b697-4ff1-80f1-ca6caa46e790 req-adcf1b50-c2c1-43d5-95ce-1c144d982d45 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:05.303856 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b16088c2-b697-4ff1-80f1-ca6caa46e790 req-adcf1b50-c2c1-43d5-95ce-1c144d982d45 service nova] Creating event network-changed:6054d191-78ab-4624-8140-5490d83b9f75 for instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 on hv-cinder-83608 Aug 09 18:05:05.309251 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b16088c2-b697-4ff1-80f1-ca6caa46e790 req-adcf1b50-c2c1-43d5-95ce-1c144d982d45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075922 Aug 09 18:05:05.313900 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 438/903] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:05:05.545498 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:05.560197 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-327ea814-94d1-40c8-87e7-323c42e360d2 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.460437 Aug 09 18:05:05.575564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 466/904] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:05 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:06.585384 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:06.586153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:06.593902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:06.594447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:06.595179 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:06.596094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:06.596667 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:06.597201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:07.000097 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:07.016456 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7326ecaf-56c7-4ab0-aea7-2d93a8d79e4d tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.436339 Aug 09 18:05:07.017047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 439/905] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:06 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:08.043499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:08.045640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:08.064890 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:08.086699 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:08.087263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:08.089873 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:08.093149 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:08.093773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:08.466419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:08.495399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f4856db2-700b-4c22-a62f-59c82f25dce6 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.461257 Aug 09 18:05:08.497286 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 467/906] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:08 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:09.521858 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:09.521858 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:09.537334 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:09.538247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:09.546401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:09.549890 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:09.550512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:09.550958 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:09.748849 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:09.757478 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7b5d61ed-353a-4a4f-87f1-cdd178797f03 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.242772 Aug 09 18:05:09.767136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 440/907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:09 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:09.883611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0b2a6013-861a-47c9-bbae-f13f5670b129 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Action: 'create', calling method: .version_select at 0x7f8c0b03a310>, body: {"keypair": {"name": "tempest-TestShelveInstance-707777160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ8Qk+cCRrZ82C4+JcWAd1xQyt/kW1ITPBSZnjjxMswZpsIo12mFv2/UmZ/jK3VgMB9OU2YG4v69f2kJsBJDzHt3ke9tI4tAW/6W3SXOf3FtBcnzVlFglsVa+wyV7edmQ=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:09.902075 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-0b2a6013-861a-47c9-bbae-f13f5670b129 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Getting quotas for project d6b4958df154416a820335d272cec49d. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:05:09.911903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-0b2a6013-861a-47c9-bbae-f13f5670b129 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Getting quotas for user 8f8ef87496bb43d1bab7c5f6f101d6aa and project d6b4958df154416a820335d272cec49d. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:05:09.940526 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0b2a6013-861a-47c9-bbae-f13f5670b129 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.393796 Aug 09 18:05:09.943184 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 468/908] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 18:05:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:05:10.779946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:10.780632 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:10.793739 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:10.794193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:10.796169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:10.799602 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:10.803033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:10.803703 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:11.014097 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:11.032429 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-26e9cece-014c-44ef-88dd-20f4f0a082ee tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.257031 Aug 09 18:05:11.058698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 441/909] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:10 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:11.603135 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-014983d9-3c36-49ca-b07a-47e611bb9bf7 req-9efa54e7-f6f5-4bce-99f5-96ed416f5634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cced02b-6537-4a96-92d1-128ed63b6ed1", "name": "network-vif-plugged", "status": "completed", "tag": "6054d191-78ab-4624-8140-5490d83b9f75"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:11.617776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:11.632274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-014983d9-3c36-49ca-b07a-47e611bb9bf7 req-9efa54e7-f6f5-4bce-99f5-96ed416f5634 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:11.632759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-014983d9-3c36-49ca-b07a-47e611bb9bf7 req-9efa54e7-f6f5-4bce-99f5-96ed416f5634 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:11.633195 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-014983d9-3c36-49ca-b07a-47e611bb9bf7 req-9efa54e7-f6f5-4bce-99f5-96ed416f5634 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:11.646215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-014983d9-3c36-49ca-b07a-47e611bb9bf7 req-9efa54e7-f6f5-4bce-99f5-96ed416f5634 service nova] Creating event network-vif-plugged:6054d191-78ab-4624-8140-5490d83b9f75 for instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 on hv-cinder-83608 Aug 09 18:05:11.652167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-014983d9-3c36-49ca-b07a-47e611bb9bf7 req-9efa54e7-f6f5-4bce-99f5-96ed416f5634 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055510 Aug 09 18:05:11.653275 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 469/910] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:05:12.064027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:12.064646 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:12.072435 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:12.079280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:12.079704 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:12.080137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:12.080836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:12.081282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:12.081733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:12.255202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:12.273853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f3b5e99b-799d-49a8-a132-ad8d4e3bb4fb tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.218204 Aug 09 18:05:12.278036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 442/911] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:12 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:13.301827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:13.302745 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:13.310244 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:13.310828 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:13.311361 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:13.312160 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:13.312683 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:13.313177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:13.476448 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:13.488543 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-06a1ea34-1f98-43a0-93f7-dc052b3785f9 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.191341 Aug 09 18:05:13.496717 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 470/912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:13 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:14.510205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:14.510859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:14.517070 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:14.517566 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:14.518013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:14.518854 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:14.519350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:14.519777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:14.652502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:14.660123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7e5c12e5-a767-40f2-92fb-9724e1c08341 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.153804 Aug 09 18:05:14.660706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 443/913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:14 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:15.681263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:15.682004 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:15.688501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:15.688979 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:15.689508 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:15.690270 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:15.690723 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:15.691289 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:15.828269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:15.835703 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-651f41ee-5973-4ca4-9c1a-73ed7ec120e5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1319 microversion: 2.1 time: 0.158234 Aug 09 18:05:15.836277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 471/914] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:15 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:16.856815 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:16.857427 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:16.859761 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:16.865116 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:16.865604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:16.866044 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:16.866739 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:16.867226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:16.867655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:17.009333 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:17.016876 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4a886d6c-bfbd-4428-ae99-11b112b7bc56 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1508 microversion: 2.1 time: 0.163955 Aug 09 18:05:17.017438 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 444/915] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:16 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:17.037865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e35b59a-f6ad-44f1-bb6c-bacecafec4c7", "device": "/dev/sdb"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:17.040681 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:17.047129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:17.047605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:17.048038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:17.048726 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:17.049174 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:17.049592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:17.572475 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6de75686-492c-439e-be82-355c3fd205de tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "POST /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538969 Aug 09 18:05:17.573682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 472/916] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:05:17 2022] POST /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:05:46.300787 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:46.301292 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:46.303291 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:46.304123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=44 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:46.310151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:46.310636 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:46.311096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:46.311783 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:46.312236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:46.312657 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:46.394362 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lazy-loading 'services' on Instance uuid 3cced02b-6537-4a96-92d1-128ed63b6ed1 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:05:46.467184 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b9015a8d-1d96-4389-9c91-74f4100c95f7 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1/os-volume_attachments/7e35b59a-f6ad-44f1-bb6c-bacecafec4c7" status: 202 len: 0 microversion: 2.1 time: 0.170363 Aug 09 18:05:46.467775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 445/917] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:05:46 2022] DELETE /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1/os-volume_attachments/7e35b59a-f6ad-44f1-bb6c-bacecafec4c7 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:05:47.589132 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:47.589713 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:47.592133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=10 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:47.592986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:47.593593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:47.600839 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:47.601315 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:47.601783 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:47.602472 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:47.602942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:47.603394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:47.630299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:05:47.705396 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b1ece744-5c26-4167-931e-0c461058ae30 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 204 len: 0 microversion: 2.1 time: 0.120113 Aug 09 18:05:47.705992 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 473/918] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:05:47 2022] DELETE /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:05:47.715554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:47.716258 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:47.722646 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:47.723756 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:47.723910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:47.724593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:47.724945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:47.725428 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:47.861259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:47.869393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-18f2fc9b-d585-4c13-9c92-cb94effbfbc5 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1514 microversion: 2.1 time: 0.157981 Aug 09 18:05:47.869990 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 446/919] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:47 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:48.567213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-576347033", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-707777160", "security_groups": [{"name": "tempest-secgroup-smoke-815153956"}], "networks": [{"uuid": "f4a359ea-fa95-498e-b4e4-588faeac3d0f"}], "block_device_mapping_v2": [{"uuid": "a770ad2e-8f25-41eb-9f1d-2872600cbf5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:48.691865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] validate_networks() for [('f4a359ea-fa95-498e-b4e4-588faeac3d0f', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:05:48.890314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:48.891149 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:48.897603 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:48.898085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:48.898519 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:48.899240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:48.899693 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:48.900116 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:49.114555 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:49.122463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5751d643-010e-48b7-9b28-8677bf4f4bc8 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1514 microversion: 2.1 time: 0.235982 Aug 09 18:05:49.123056 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 447/920] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:48 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:49.151626 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:05:49.152041 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:05:49.152506 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:05:49.152906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:05:49.153337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:05:49.161979 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:49.162447 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:49.162867 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:49.163605 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:49.164051 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:49.164458 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:49.180771 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Getting quotas for project d6b4958df154416a820335d272cec49d. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:05:49.185115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Getting quotas for user 8f8ef87496bb43d1bab7c5f6f101d6aa and project d6b4958df154416a820335d272cec49d. Resources: {'instances', 'cores', 'ram'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:05:49.240705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:05:49.242863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a770ad2e-8f25-41eb-9f1d-2872600cbf5f',volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:05:49.371375 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-206f13a9-4810-4d2a-bab8-0b94e84a3c79 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.808157 Aug 09 18:05:49.372038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 474/921] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:05:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:05:49.391180 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1a437a62-0d0e-410e-afa9-a77284f3f675 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:49.391967 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1a437a62-0d0e-410e-afa9-a77284f3f675 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:49.446197 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1a437a62-0d0e-410e-afa9-a77284f3f675 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:49.453375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1a437a62-0d0e-410e-afa9-a77284f3f675 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1087 microversion: 2.1 time: 0.072229 Aug 09 18:05:49.454305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 448/922] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:49 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:50.144333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:50.145470 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:50.154180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:50.154663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:50.155112 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:50.155811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:50.156258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:50.156677 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:50.168065 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b219ab2f-ea63-45a6-8356-e694b033b6d8 req-818a32da-8f2e-4c17-af97-a118ca819a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cced02b-6537-4a96-92d1-128ed63b6ed1", "name": "network-vif-deleted", "tag": "6054d191-78ab-4624-8140-5490d83b9f75"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:50.178389 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b219ab2f-ea63-45a6-8356-e694b033b6d8 req-818a32da-8f2e-4c17-af97-a118ca819a91 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:50.178864 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b219ab2f-ea63-45a6-8356-e694b033b6d8 req-818a32da-8f2e-4c17-af97-a118ca819a91 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:50.179547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b219ab2f-ea63-45a6-8356-e694b033b6d8 req-818a32da-8f2e-4c17-af97-a118ca819a91 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:50.190857 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b219ab2f-ea63-45a6-8356-e694b033b6d8 req-818a32da-8f2e-4c17-af97-a118ca819a91 service nova] Creating event network-vif-deleted:6054d191-78ab-4624-8140-5490d83b9f75 for instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 on hv-cinder-83608 Aug 09 18:05:50.195778 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b219ab2f-ea63-45a6-8356-e694b033b6d8 req-818a32da-8f2e-4c17-af97-a118ca819a91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031389 Aug 09 18:05:50.196371 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 449/923] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:05:50.222349 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842b7f1ea05f41d0b000f97ee9bf7196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae6073847f2416da72f6c9276da44cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:50.230145 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-73502f66-4c7c-40f4-af31-25da9d45d576 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 200 len: 1472 microversion: 2.1 time: 0.089822 Aug 09 18:05:50.230720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 475/924] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:50 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:50.475895 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:50.476700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:50.483062 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:50.483626 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:50.484423 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:50.485337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:50.485863 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:50.486356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:50.555111 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:50.563708 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-61b9b8cc-7554-4abe-b784-3746972dd426 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1193 microversion: 2.1 time: 0.092395 Aug 09 18:05:50.564285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 450/925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:50 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:51.254359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:51.256095 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] [instance: 3cced02b-6537-4a96-92d1-128ed63b6ed1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:51.263854 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:51.264598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:51.265155 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:51.265863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:51.266356 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:51.266778 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:51.286511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] HTTP exception thrown: Instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 could not be found. Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Request method failure captured: Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 HTTP/1.1 Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qF2rWI-f4J0x7fAoLRilY6lk79nK1QblawcUicrZYPjahtdGCQM8xFuAXBn6Vfh9YhseBbKW_VeFrLbnQ_LV3kAB08e7wjpWrd9HK44nGBSFkDy03_UQyO4F2HavlMru2MIraBa7JQoI-BsFUWrizWVfFWjOHyPRXGa-7NK38Qzndk Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: fae6073847f2416da72f6c9276da44cf Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1079152397 Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:05:51.288978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fae6073847f2416da72f6c9276da44cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fae6073847f2416da72f6c9276da44cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fae6073847f2416da72f6c9276da44cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fae6073847f2416da72f6c9276da44cf", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotTestJSON-1079152397 Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: fae6073847f2416da72f6c9276da44cf Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1079152397 Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotTestJSON-1079152397-project Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 842b7f1ea05f41d0b000f97ee9bf7196 Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotTestJSON-1079152397-project Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 could not be found. Aug 09 18:05:51.291776 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': '3cced02b-6537-4a96-92d1-128ed63b6ed1'} Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 could not be found. Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:05:51.292834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 could not be found. Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 could not be found. Aug 09 18:05:51.294427 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:05:51.296857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] Returning 404 to user: Instance 3cced02b-6537-4a96-92d1-128ed63b6ed1 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:05:51.298768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-59038255-2b52-4e15-a21c-a9b0a55517f0 tempest-VolumesSnapshotTestJSON-1079152397 tempest-VolumesSnapshotTestJSON-1079152397-project] 10.222.0.52 "GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1" status: 404 len: 111 microversion: 2.1 time: 0.051482 Aug 09 18:05:51.299484 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 476/926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:51 2022] GET /compute/v2.1/servers/3cced02b-6537-4a96-92d1-128ed63b6ed1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:05:51.589845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:51.589845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:51.595836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:51.596590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:51.597090 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:51.597795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:51.598256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:51.598691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:51.753174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:51.762087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-db63aa17-9374-4deb-9623-2738093d5a51 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.179908 Aug 09 18:05:51.762802 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 451/927] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:51 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:52.227315 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a39e24f7-f5fc-4ce7-bee0-c90e5522a6f8 req-abe5f046-3d69-44b1-9e34-bd140c0ddc11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c61ae7-015c-4681-ba47-07ff241ccb0f", "tag": "32317f6f-aed5-46e5-940f-2b0d283ac7ed"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:52.238700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a39e24f7-f5fc-4ce7-bee0-c90e5522a6f8 req-abe5f046-3d69-44b1-9e34-bd140c0ddc11 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:52.239445 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a39e24f7-f5fc-4ce7-bee0-c90e5522a6f8 req-abe5f046-3d69-44b1-9e34-bd140c0ddc11 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:52.239943 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a39e24f7-f5fc-4ce7-bee0-c90e5522a6f8 req-abe5f046-3d69-44b1-9e34-bd140c0ddc11 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:52.254698 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a39e24f7-f5fc-4ce7-bee0-c90e5522a6f8 req-abe5f046-3d69-44b1-9e34-bd140c0ddc11 service nova] Creating event network-changed:32317f6f-aed5-46e5-940f-2b0d283ac7ed for instance 47c61ae7-015c-4681-ba47-07ff241ccb0f on hv-cinder-83608 Aug 09 18:05:52.260564 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a39e24f7-f5fc-4ce7-bee0-c90e5522a6f8 req-abe5f046-3d69-44b1-9e34-bd140c0ddc11 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037471 Aug 09 18:05:52.261559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 477/928] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:05:52.785869 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:52.786801 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:52.795569 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:52.796121 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:52.796881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:52.798001 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:52.798552 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:52.799097 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:52.979611 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:52.993210 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-98e06483-5e00-4aa4-a6f5-c9dc777c3133 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.212512 Aug 09 18:05:52.993914 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 452/929] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:52 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:54.018830 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:54.019733 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:54.028011 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:54.028288 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:54.028885 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:54.029708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:54.030539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:54.031128 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:54.293861 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:54.302643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ae52667c-c820-4911-b563-5ff4e00da478 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.289423 Aug 09 18:05:54.316751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 478/930] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:54 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:55.325368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:55.325949 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:55.332558 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:55.333306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:55.334096 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:55.334819 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:55.335305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:55.335737 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:55.884414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:55.892213 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-09e488d8-05b0-422d-9d47-31fee6a6729b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.570994 Aug 09 18:05:55.893480 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 453/931] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:55 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:56.914659 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:56.916337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:56.925212 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:56.926396 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:56.927107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:56.928066 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:56.928930 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:56.929568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:57.212474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:57.220768 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4811767e-490d-462f-92e5-dfb8989b2a24 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.310707 Aug 09 18:05:57.221992 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 479/932] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:56 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:58.246321 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:58.247282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:58.254682 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:58.255203 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:58.255640 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:58.256349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:58.256836 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:58.257260 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:58.431528 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:58.439727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2829c904-6019-44bb-b680-849f47ed733d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.201556 Aug 09 18:05:58.440311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 454/933] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:58 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:59.462358 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:59.463840 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:59.467227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:59.468067 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:59.476689 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:59.477187 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:59.477770 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:59.479347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:59.480467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:59.481267 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:59.641422 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:59.657632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-653d1642-f3ba-4480-a805-d41791872b21 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.194735 Aug 09 18:05:59.662837 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 480/934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:59 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:00.672350 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:00.672973 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:00.676158 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:00.683077 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:00.683561 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:00.684193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:00.685057 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:00.685662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:00.686080 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:00.830724 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:00.840052 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3f6b2d83-d277-4c0a-b44d-489f76f60046 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.171638 Aug 09 18:06:00.851387 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 455/935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:00 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:01.863107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:01.863852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:01.878586 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:01.880718 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:01.883055 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:01.884479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:01.888398 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:01.889254 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:02.209626 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:02.217424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c845bc37-08c1-4a57-ae6a-5866dbe27d3b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.359460 Aug 09 18:06:02.230906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 481/936] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:01 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:03.240768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:03.241402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:03.247956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:03.248457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:03.248926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:03.249625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:03.250086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:03.250518 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:03.626184 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:03.637891 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0106c4b5-4807-487f-9015-65a35df8273b tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.400841 Aug 09 18:06:03.651086 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 456/937] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:03 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:04.038761 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-56d47eac-5c5e-4eb3-b13f-9026407bc179 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Action: 'create', calling method: .version_select at 0x7f8c0b03fa60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-873891623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcajT+rvuPB8Om3mRzcnZ/IGZsAu+Thzs7BQlmUkTxi8aajlzSNwVWkJ39iSj3EfmFp01EFKUYZ0eq02M9EG70pLD6tet0kv5CxhFQ1/8iWHF2rMv5wo8g57rMZ7dJygw=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:04.057230 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-56d47eac-5c5e-4eb3-b13f-9026407bc179 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:06:04.064160 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-56d47eac-5c5e-4eb3-b13f-9026407bc179 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for user 8bf28be46c9c4d9c9f5a7c5837545fa4 and project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:06:04.091756 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-56d47eac-5c5e-4eb3-b13f-9026407bc179 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.303211 Aug 09 18:06:04.092508 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 482/938] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 18:06:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:06:04.659170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:04.660573 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:04.667353 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:04.667797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:04.668426 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:04.669132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:04.669587 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:04.670220 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:04.882752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:04.892494 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cd7b3ddc-81fb-4fc9-9794-23aada5198e0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.237601 Aug 09 18:06:04.893498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 457/939] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:04 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:05.913519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:05.914123 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:05.923990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:05.925805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:05.926251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:05.926957 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:05.927611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:05.928218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:06.207990 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:06.216371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c7db7757-657c-43d4-92b6-d6e153ae6074 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.306695 Aug 09 18:06:06.216941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 483/940] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:05 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:06.805743 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b8da88b7-fed7-46bf-a20e-b26ffd44de6c req-aa2aa68a-5f08-4631-8fc5-2db7d2421b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c61ae7-015c-4681-ba47-07ff241ccb0f", "name": "network-vif-plugged", "status": "completed", "tag": "32317f6f-aed5-46e5-940f-2b0d283ac7ed"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:06.818781 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b8da88b7-fed7-46bf-a20e-b26ffd44de6c req-aa2aa68a-5f08-4631-8fc5-2db7d2421b69 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:06.819387 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b8da88b7-fed7-46bf-a20e-b26ffd44de6c req-aa2aa68a-5f08-4631-8fc5-2db7d2421b69 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:06.819908 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b8da88b7-fed7-46bf-a20e-b26ffd44de6c req-aa2aa68a-5f08-4631-8fc5-2db7d2421b69 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:06.832688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b8da88b7-fed7-46bf-a20e-b26ffd44de6c req-aa2aa68a-5f08-4631-8fc5-2db7d2421b69 service nova] Creating event network-vif-plugged:32317f6f-aed5-46e5-940f-2b0d283ac7ed for instance 47c61ae7-015c-4681-ba47-07ff241ccb0f on hv-cinder-83608 Aug 09 18:06:06.838945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b8da88b7-fed7-46bf-a20e-b26ffd44de6c req-aa2aa68a-5f08-4631-8fc5-2db7d2421b69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037129 Aug 09 18:06:06.839949 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 458/941] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:06:07.237949 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:07.238695 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:07.246385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:07.246966 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:07.247549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:07.248323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:07.248852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:07.249351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:07.412995 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:07.421086 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-333e0fe2-5155-4d72-a13f-3aca40f9e48c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.187265 Aug 09 18:06:07.435150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 484/942] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:07 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:08.443223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:08.443916 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:08.450951 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:08.451456 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:08.451886 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:08.452570 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:08.453016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:08.453431 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:08.646076 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:08.654694 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4263f570-6a22-4691-b32c-126b86919530 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1258 microversion: 2.1 time: 0.216155 Aug 09 18:06:08.655835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 459/943] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:08 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1258 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:09.676449 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:09.677070 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:09.684818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:09.685106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:09.685512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:09.686342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:09.686862 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:09.687389 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:09.843760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:09.860460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d07a775b-ec1a-45be-b9fd-f06b66f1c2b7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1443 microversion: 2.1 time: 0.187772 Aug 09 18:06:09.861027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 485/944] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:09 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1443 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:09.881364 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:09.882031 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:09.889066 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:09.889542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:09.889974 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:09.890651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:09.891203 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:09.891668 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:10.032206 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:10.040544 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-90ed3cfc-b175-446d-942b-3c19b0b53492 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1443 microversion: 2.1 time: 0.162691 Aug 09 18:06:10.041114 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 460/945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:09 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:12.080012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-602f6a19-00c3-4a6e-93c9-d3a7d5f7f52e req-f2d4084a-8be5-4046-8cde-69a2d3563dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c61ae7-015c-4681-ba47-07ff241ccb0f", "tag": "32317f6f-aed5-46e5-940f-2b0d283ac7ed"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:12.090382 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-602f6a19-00c3-4a6e-93c9-d3a7d5f7f52e req-f2d4084a-8be5-4046-8cde-69a2d3563dc7 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:12.090858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-602f6a19-00c3-4a6e-93c9-d3a7d5f7f52e req-f2d4084a-8be5-4046-8cde-69a2d3563dc7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:12.091333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-602f6a19-00c3-4a6e-93c9-d3a7d5f7f52e req-f2d4084a-8be5-4046-8cde-69a2d3563dc7 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:12.102923 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-602f6a19-00c3-4a6e-93c9-d3a7d5f7f52e req-f2d4084a-8be5-4046-8cde-69a2d3563dc7 service nova] Creating event network-changed:32317f6f-aed5-46e5-940f-2b0d283ac7ed for instance 47c61ae7-015c-4681-ba47-07ff241ccb0f on hv-cinder-83608 Aug 09 18:06:12.107928 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-602f6a19-00c3-4a6e-93c9-d3a7d5f7f52e req-f2d4084a-8be5-4046-8cde-69a2d3563dc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031651 Aug 09 18:06:12.108621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 486/946] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:06:20.244337 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:06:20.244952 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Tue Aug 9 18:06:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:06:21.829415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=34 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:21.831226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:21.835332 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1297438547", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-873891623", "security_groups": [{"name": "tempest-secgroup-smoke-487061353"}], "block_device_mapping_v2": [{"uuid": "e328feb4-0de4-43ed-acb1-efa70ede52b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "648dec17-b3e5-45a9-93fb-a5a15bae0307"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:21.993497 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] validate_networks() for [('648dec17-b3e5-45a9-93fb-a5a15bae0307', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:06:22.544095 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:06:22.544725 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:06:22.545379 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:06:22.545953 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:06:22.546720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:06:22.558414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:22.558901 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:22.559547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:22.560280 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:22.560733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:22.561157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:22.591942 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:06:22.600268 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for user 8bf28be46c9c4d9c9f5a7c5837545fa4 and project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:06:22.687181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:06:22.689910 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e328feb4-0de4-43ed-acb1-efa70ede52b2',volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:06:22.900263 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [b1b79c13-9de7-487a-804b-07d45d7d0809] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:06:23.909584 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [b1b79c13-9de7-487a-804b-07d45d7d0809] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 47804. Aug 09 18:06:23.915359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cee98bd1-e9aa-480a-be8c-db6a055837ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.086924 Aug 09 18:06:23.921707 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 461/947] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:06:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:06:23.924867 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:23.926329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:23.926958 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:23.937223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c76f1ab7-adf1-4d65-ae56-1088137a4545 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:23.941338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c76f1ab7-adf1-4d65-ae56-1088137a4545 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:24.028299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c76f1ab7-adf1-4d65-ae56-1088137a4545 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:24.037422 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c76f1ab7-adf1-4d65-ae56-1088137a4545 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1094 microversion: 2.1 time: 0.112420 Aug 09 18:06:24.040611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 487/948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:23 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:25.058177 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:25.060381 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:25.090875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:25.091872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:25.092735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:25.093652 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:25.094304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:25.095118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:25.172609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:25.186211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b490a360-452e-4354-b398-4d20294d07a9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1192 microversion: 2.1 time: 0.132279 Aug 09 18:06:25.189459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 462/949] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:25 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1192 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:26.211813 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:26.213108 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:26.220300 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:26.221124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:26.221783 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:26.222769 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:26.223476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:26.224278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:26.448333 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:26.461675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-55bdc6f3-9a02-4cb0-8833-fa7ce89e052f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.254875 Aug 09 18:06:26.475263 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 488/950] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:26 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:27.276492 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-26587cf4-d454-405c-8d4b-0c914337d15c req-5c351e02-0d73-4d33-9298-1c1bede8f582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02ce720-286e-4766-8b03-92b699d90db9", "tag": "b0bbc7cc-bbe0-4d35-a880-30f11ca8853f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:27.292697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-26587cf4-d454-405c-8d4b-0c914337d15c req-5c351e02-0d73-4d33-9298-1c1bede8f582 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:27.293583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-26587cf4-d454-405c-8d4b-0c914337d15c req-5c351e02-0d73-4d33-9298-1c1bede8f582 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:27.294260 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-26587cf4-d454-405c-8d4b-0c914337d15c req-5c351e02-0d73-4d33-9298-1c1bede8f582 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:27.308736 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-26587cf4-d454-405c-8d4b-0c914337d15c req-5c351e02-0d73-4d33-9298-1c1bede8f582 service nova] Creating event network-changed:b0bbc7cc-bbe0-4d35-a880-30f11ca8853f for instance d02ce720-286e-4766-8b03-92b699d90db9 on hv-cinder-83608 Aug 09 18:06:27.319293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-26587cf4-d454-405c-8d4b-0c914337d15c req-5c351e02-0d73-4d33-9298-1c1bede8f582 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046332 Aug 09 18:06:27.320286 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 463/951] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:06:27.483719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:27.484314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:27.497107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:27.497606 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:27.498040 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:27.504161 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:27.504644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:27.505135 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:27.677521 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:27.690082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6becb1df-6206-4731-bcb4-011390ec7661 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.210297 Aug 09 18:06:27.691320 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 489/952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:27 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:28.712585 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:28.713291 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:28.720655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:28.721390 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:28.722012 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:28.722885 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:28.723629 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:28.724215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:28.887769 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:28.898122 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e6f4044d-3b69-44a6-8468-8fcbe3843d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.190058 Aug 09 18:06:28.899585 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 464/953] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:28 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:29.919870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:29.920482 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:29.931634 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:29.932365 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:29.932984 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:29.933877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:29.934327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:29.934938 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:30.111499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:30.121176 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-84a7088e-f6b7-4dc5-8054-d439dc896473 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.205147 Aug 09 18:06:30.122337 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 490/954] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:29 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:31.145533 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:31.146271 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:31.153332 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:31.154219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:31.154737 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:31.155632 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:31.156168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:31.156670 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:31.307999 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:31.317937 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-17501a29-ea4b-448b-9479-eb04bb348035 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.176256 Aug 09 18:06:31.318537 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 465/955] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:31 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:32.346642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:32.346642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:32.352652 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:32.353397 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:32.354025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:32.354929 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:32.355965 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:32.356383 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:32.503142 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:32.511903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bb321988-75cb-4506-83c3-dc8d02d7a699 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.170723 Aug 09 18:06:32.512666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 491/956] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:32 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:33.534411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:33.535062 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:33.537542 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:33.538222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:33.549795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:33.551625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:33.551625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:33.551625 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:33.551904 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:33.552184 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:33.702104 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:33.710698 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8c2efcc6-dbec-47ad-add6-8f190257bc2b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.180359 Aug 09 18:06:33.712229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 466/957] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:33 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:34.401539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f2859f27-709a-4ed7-9839-df2ae270c183 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Action: 'create', calling method: .version_select at 0x7f8c0b071280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1581373665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML17Y4XIe5xjwfYuAOnbb+PcDbnJ7b1R74X18eOhflNNzqrEtF3vUxFSmQW22tWXETCNzrIKnGBGydh6pyj8RVJa98SpOZGVdE/8eopAB7P+Fsy4kmOPIbp9PtGdUkM/g=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:34.407314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:34.419621 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-f2859f27-709a-4ed7-9839-df2ae270c183 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Getting quotas for project 1b9d999e96684373b7fe94b07d007eee. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:06:34.423819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-f2859f27-709a-4ed7-9839-df2ae270c183 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Getting quotas for user 83be648a00b24d7082a01c56f4317069 and project 1b9d999e96684373b7fe94b07d007eee. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:06:34.446176 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f2859f27-709a-4ed7-9839-df2ae270c183 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048578 Aug 09 18:06:34.446774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 492/958] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 9 18:06:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:06:34.497391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1726299006", "imageRef": "403f5798-1300-4835-981f-44245116b535", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1581373665", "networks": [{"uuid": "33b48d47-626d-475c-9ac0-37af88b9fc1d"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:34.548313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] validate_networks() for [('33b48d47-626d-475c-9ac0-37af88b9fc1d', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:06:34.732881 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:34.733501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:34.740100 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:34.740591 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:34.741026 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:34.741719 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:34.742227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:34.742673 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:34.966324 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:34.973724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d4d250e8-80f8-46d0-b3d7-f5ddca9a03d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.244668 Aug 09 18:06:34.974288 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 493/959] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:34 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:06:35.006440 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:06:35.006866 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:06:35.007393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:06:35.008319 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:06:35.008733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:06:35.017391 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:35.017870 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:35.018308 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:35.019099 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:35.019556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:35.019982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:35.036829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Getting quotas for project 1b9d999e96684373b7fe94b07d007eee. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:06:35.040762 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Getting quotas for user 83be648a00b24d7082a01c56f4317069 and project 1b9d999e96684373b7fe94b07d007eee. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:06:35.051546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:06:35.053696 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='403f5798-1300-4835-981f-44245116b535',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:06:35.098950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c661ebf5-76de-4361-8c3b-7686bf6b5cf3 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605304 Aug 09 18:06:35.099875 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 467/960] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:06:35.110512 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b0f9be07-94e2-4d7b-8f55-36a1b72ae718 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:35.111426 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b0f9be07-94e2-4d7b-8f55-36a1b72ae718 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:35.166882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b0f9be07-94e2-4d7b-8f55-36a1b72ae718 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:35.173784 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b0f9be07-94e2-4d7b-8f55-36a1b72ae718 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1259 microversion: 2.1 time: 0.067257 Aug 09 18:06:35.174351 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 494/961] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:35 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:35.995016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:35.995639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:36.001928 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:36.002684 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:36.003154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:36.003859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:36.004314 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:36.004742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:36.147414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:36.155597 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e6aff768-28e5-4c0f-bb6c-c8567661e668 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.165619 Aug 09 18:06:36.156424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 468/962] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:35 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:36.193747 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:36.194428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:36.201272 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:36.201773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:36.202191 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:36.202884 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:36.203360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:36.203781 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:36.269924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:36.279549 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0ec2e303-3c52-4210-99a8-2eb911c9d33b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1329 microversion: 2.1 time: 0.089699 Aug 09 18:06:36.280129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 495/963] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:36 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1329 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:37.178242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:37.179959 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:37.191168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:37.192388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:37.206743 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:37.207946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:37.208576 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:37.209158 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:37.302167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:37.303462 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:37.318899 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:37.321133 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:37.322227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:37.323354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:37.325147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:37.325833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:37.516118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:37.525282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7b186f93-0e9d-4a99-8a71-42e3bdfb21ba tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.351439 Aug 09 18:06:37.535141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 469/964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:37 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:37.544576 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:37.552925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fca5ce1f-8f10-49e8-85ff-e7a3db2874be tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.255007 Aug 09 18:06:37.554134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 496/965] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:37 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:06:38.549161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:38.550171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:38.557261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:38.557829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:38.558341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:38.559188 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:38.560020 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:38.560512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:38.573952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:38.574802 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:38.581446 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:38.582020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:38.582528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:38.583332 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:38.583854 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:38.584590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:38.797577 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:38.809696 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-06776363-77f5-412e-8435-d316d0ba6243 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.266303 Aug 09 18:06:38.816154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 470/966] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:38 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:38.821706 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-a8688ea4-9664-4f78-9c98-34c39153213e req-83b2c396-c024-4992-a668-8e9ed11cadda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02ce720-286e-4766-8b03-92b699d90db9", "name": "network-vif-plugged", "status": "completed", "tag": "b0bbc7cc-bbe0-4d35-a880-30f11ca8853f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:38.840176 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:38.850388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1e492a2c-8dee-4d26-9a2d-53b9ff069d90 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.280246 Aug 09 18:06:38.854073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 497/967] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:38 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:38.856217 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a8688ea4-9664-4f78-9c98-34c39153213e req-83b2c396-c024-4992-a668-8e9ed11cadda service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:38.856870 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a8688ea4-9664-4f78-9c98-34c39153213e req-83b2c396-c024-4992-a668-8e9ed11cadda service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:38.857479 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a8688ea4-9664-4f78-9c98-34c39153213e req-83b2c396-c024-4992-a668-8e9ed11cadda service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:38.870219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-a8688ea4-9664-4f78-9c98-34c39153213e req-83b2c396-c024-4992-a668-8e9ed11cadda service nova] Creating event network-vif-plugged:b0bbc7cc-bbe0-4d35-a880-30f11ca8853f for instance d02ce720-286e-4766-8b03-92b699d90db9 on hv-cinder-83608 Aug 09 18:06:38.880164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-a8688ea4-9664-4f78-9c98-34c39153213e req-83b2c396-c024-4992-a668-8e9ed11cadda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062417 Aug 09 18:06:38.881421 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 471/968] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:06:39.841111 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:39.841635 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:39.849102 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:39.849924 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:39.850716 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:39.851697 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:39.852383 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:39.853068 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:39.875077 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:39.876118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:39.882281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:39.883611 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:39.883945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:39.884604 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:39.885082 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:39.885531 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:40.082479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:40.094639 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:40.099018 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dd8ee0f3-e964-418d-9fa8-3ff114ac425f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.261731 Aug 09 18:06:40.102645 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fc619fa4-8f68-4308-83df-915002c42f05 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.231966 Aug 09 18:06:40.103971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 472/969] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:39 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:06:40.112893 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 498/970] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:39 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:41.122477 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:41.123396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:41.130560 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:41.131460 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:41.132281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:41.133640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:41.134314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:41.134833 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:41.135543 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:41.136200 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:41.141107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:41.142009 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:41.142468 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:41.143202 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:41.143651 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:41.144073 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:41.347067 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:41.350660 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:41.355216 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-91feb41c-ae97-4d15-97c3-0770bd03aeac tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.226139 Aug 09 18:06:41.356072 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 499/971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:41 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:41.360205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-de932150-c935-4b24-affd-0181fd41c4fd tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.242195 Aug 09 18:06:41.362383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 473/972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:41 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:42.376634 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:42.377540 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:42.381633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:42.382244 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:42.384514 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:42.384986 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:42.385414 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:42.386102 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:42.386547 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:42.386962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:42.389068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:42.389553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:42.389989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:42.390683 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:42.391164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:42.391587 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:42.581975 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:42.595931 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ed3498bc-c7df-4566-ada3-762cdb925153 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.217874 Aug 09 18:06:42.597429 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 474/973] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:42 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:06:42.609764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:42.618088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4afc7f33-d8da-4b6a-a405-a3a8ce790c95 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.245273 Aug 09 18:06:42.632199 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 500/974] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:42 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:43.620279 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:43.621841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:43.628755 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:43.629320 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:43.629823 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:43.630593 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:43.631156 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:43.631941 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:43.640037 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:43.640636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:43.646737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:43.647236 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:43.647663 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:43.648347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:43.648791 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:43.649205 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:43.847942 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:43.856697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4a317d05-159d-4540-9b94-288b41666325 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.240586 Aug 09 18:06:43.871388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 475/975] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:43 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:43.875473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:43.886963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-41493781-af2c-4abb-a450-4d7364cdac30 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.250584 Aug 09 18:06:43.887577 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 501/976] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:43 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:44.878789 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:44.879514 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:44.885510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:44.885991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:44.886428 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:44.887151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:44.887605 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:44.888033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:44.908507 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:44.909147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:44.916310 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:44.916790 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:44.917227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:44.917919 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:44.918377 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:44.918805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:45.028467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:45.046988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:45.171231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:45.405283 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:45.414507 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c6d62fb2-2e2e-4e43-8d3d-f0a1bba7a606 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.539302 Aug 09 18:06:45.424027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:45.431274 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 476/977] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:44 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:45.433942 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-83ca24fd-d3bd-49e0-9f9f-086c6d63581a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.529215 Aug 09 18:06:45.443172 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 502/978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:44 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:06:45.843645 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-bd05f572-78ad-49f7-8a50-adc8425a683b req-fb54efaf-b3ad-467d-9160-49f4cde69e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eeb373-cd02-4eaf-b024-455515993714", "tag": "5429f201-caa5-4c40-bfd2-9d7fcda2385e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:45.853941 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-bd05f572-78ad-49f7-8a50-adc8425a683b req-fb54efaf-b3ad-467d-9160-49f4cde69e53 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:45.854424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-bd05f572-78ad-49f7-8a50-adc8425a683b req-fb54efaf-b3ad-467d-9160-49f4cde69e53 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:45.854862 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-bd05f572-78ad-49f7-8a50-adc8425a683b req-fb54efaf-b3ad-467d-9160-49f4cde69e53 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:45.869707 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-bd05f572-78ad-49f7-8a50-adc8425a683b req-fb54efaf-b3ad-467d-9160-49f4cde69e53 service nova] Creating event network-changed:5429f201-caa5-4c40-bfd2-9d7fcda2385e for instance a9eeb373-cd02-4eaf-b024-455515993714 on hv-cinder-83608 Aug 09 18:06:45.875372 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-bd05f572-78ad-49f7-8a50-adc8425a683b req-fb54efaf-b3ad-467d-9160-49f4cde69e53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169582 Aug 09 18:06:45.875976 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 477/979] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:06:46.441154 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:46.441829 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:46.448280 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:46.448753 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:46.449177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:46.449852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:46.450295 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:46.450707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:46.456586 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:46.457291 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:46.463513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:46.464156 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:46.464788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:46.465497 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:46.465954 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:46.466380 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:46.639846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:46.647411 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6bf1fd23-1b1e-4569-a8ef-0c4fd5c1aa82 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.210100 Aug 09 18:06:46.647981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 503/980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:46 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:46.661521 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:46.669742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f9f7a501-db91-4ca4-929f-20dda3c6c2f4 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.217888 Aug 09 18:06:46.670320 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 478/981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:46 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:06:47.670035 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:47.670638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:47.677092 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:47.677581 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:47.678016 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:47.678707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:47.679932 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:47.679932 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:47.693357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:47.693980 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:47.700422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:47.700909 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:47.701346 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:47.702224 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:47.702677 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:47.703135 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:47.907186 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:47.919518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7164d9cd-fbc3-4b52-bdab-adbb05fc8c56 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1265 microversion: 2.1 time: 0.253288 Aug 09 18:06:47.920275 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 504/982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:47 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:47.928631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:47.938911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ded6bdb9-3a6c-49aa-af56-89377fe46615 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.252046 Aug 09 18:06:47.939595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 479/983] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:47 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:48.941736 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:48.942382 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:48.949737 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:48.950218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:48.950647 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:48.951380 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:48.951834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:48.952253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:48.959808 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:48.960425 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:48.966607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:48.967150 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:48.967590 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:48.968288 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:48.968748 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:48.969227 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:49.145675 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:49.153413 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8b248cf8-e4b7-4738-8880-ebded1615aea tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1453 microversion: 2.1 time: 0.215494 Aug 09 18:06:49.154019 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 505/984] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:48 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:49.170173 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:49.173718 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:49.174711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:49.175434 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:49.179609 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f925df6a-aa09-4368-8962-797943cded53 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.223569 Aug 09 18:06:49.180680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 480/985] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:48 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:49.182636 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:49.183264 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:49.183701 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:49.184432 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:49.184882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:49.185298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:49.207177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:49.328788 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:49.336622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c23c0cd6-41e5-4e73-b0d6-6b02c7f35c84 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1453 microversion: 2.1 time: 0.166054 Aug 09 18:06:49.337204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 506/986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:49 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:06:50.201378 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:50.202091 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:50.208863 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:50.209365 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:50.209783 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:50.210472 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:50.210926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:50.211692 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:50.407853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:50.415708 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d2a918ec-1268-4545-86dc-f137859d0176 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.218077 Aug 09 18:06:50.416423 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 481/987] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:50 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:51.188353 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d8045652-d388-4568-b3b8-100b919a1a23 req-687253fb-fe98-4bb2-a84e-8e3f3883503e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02ce720-286e-4766-8b03-92b699d90db9", "tag": "b0bbc7cc-bbe0-4d35-a880-30f11ca8853f"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:51.197647 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d8045652-d388-4568-b3b8-100b919a1a23 req-687253fb-fe98-4bb2-a84e-8e3f3883503e service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:51.198180 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d8045652-d388-4568-b3b8-100b919a1a23 req-687253fb-fe98-4bb2-a84e-8e3f3883503e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:51.198559 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d8045652-d388-4568-b3b8-100b919a1a23 req-687253fb-fe98-4bb2-a84e-8e3f3883503e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:51.209389 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d8045652-d388-4568-b3b8-100b919a1a23 req-687253fb-fe98-4bb2-a84e-8e3f3883503e service nova] Creating event network-changed:b0bbc7cc-bbe0-4d35-a880-30f11ca8853f for instance d02ce720-286e-4766-8b03-92b699d90db9 on hv-cinder-83608 Aug 09 18:06:51.215157 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d8045652-d388-4568-b3b8-100b919a1a23 req-687253fb-fe98-4bb2-a84e-8e3f3883503e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091902 Aug 09 18:06:51.215891 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 507/988] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:06:51.437989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:51.438602 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:51.445181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:51.445826 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:51.447006 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:51.447778 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:51.448278 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:51.448648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:51.590998 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:51.599631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3d0948bf-985c-48fe-b339-cc9ca78f9ad0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.166948 Aug 09 18:06:51.600386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 482/989] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:51 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:52.622805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:52.623577 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:52.630283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:52.630760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:52.631222 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:52.631916 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:52.632366 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:52.632789 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:52.718401 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-fc78a0f6-5632-417d-b860-4ec547aceee0 req-d90e1677-3db4-4762-81a3-b6663e09d9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eeb373-cd02-4eaf-b024-455515993714", "name": "network-vif-plugged", "status": "completed", "tag": "5429f201-caa5-4c40-bfd2-9d7fcda2385e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:52.724109 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:52.731310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-fc78a0f6-5632-417d-b860-4ec547aceee0 req-d90e1677-3db4-4762-81a3-b6663e09d9e9 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:52.731799 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-fc78a0f6-5632-417d-b860-4ec547aceee0 req-d90e1677-3db4-4762-81a3-b6663e09d9e9 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:52.732230 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-fc78a0f6-5632-417d-b860-4ec547aceee0 req-d90e1677-3db4-4762-81a3-b6663e09d9e9 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:52.747578 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-fc78a0f6-5632-417d-b860-4ec547aceee0 req-d90e1677-3db4-4762-81a3-b6663e09d9e9 service nova] Creating event network-vif-plugged:5429f201-caa5-4c40-bfd2-9d7fcda2385e for instance a9eeb373-cd02-4eaf-b024-455515993714 on hv-cinder-83608 Aug 09 18:06:52.754273 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-fc78a0f6-5632-417d-b860-4ec547aceee0 req-d90e1677-3db4-4762-81a3-b6663e09d9e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039810 Aug 09 18:06:52.755992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 483/990] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:06:52.777832 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:52.786299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa91f1e9-e357-4973-b41b-715c9313b6f8 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.169578 Aug 09 18:06:52.786878 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 508/991] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:52 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:53.809554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:53.810174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:53.817435 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:53.817917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:53.818353 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:53.819085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:53.819536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:53.819960 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:53.947728 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:53.955393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f1d07edb-0cba-4052-a95e-63308a2b0341 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1359 microversion: 2.1 time: 0.151036 Aug 09 18:06:53.956144 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 484/992] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:53 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:54.976347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:54.976960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:54.979448 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:06:54.984865 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:54.985344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:54.985774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:54.986454 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:54.986909 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:54.987360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:55.118707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:55.126774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fda0358e-906a-4131-a72b-2d85241b3ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1546 microversion: 2.1 time: 0.154330 Aug 09 18:06:55.127656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 509/993] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:54 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:55.147465 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:55.148074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:55.154697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:55.155212 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:55.155648 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:55.156330 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:55.157035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:55.157176 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:55.292918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:55.300448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cf581373-75a9-4b16-9008-c11a7e4a50dc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1546 microversion: 2.1 time: 0.156862 Aug 09 18:06:55.301005 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 485/994] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:55 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:55.321062 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:55.325773 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:55.326529 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Searching by: {'deleted': False, 'project_id': '1b9d999e96684373b7fe94b07d007eee'} {{(pid=117886) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 18:06:55.333096 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:55.333563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:55.333991 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:55.334700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:55.335177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:55.335590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:55.425053 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.multi_cell_list [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 18:06:55.521467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7842ba24-1abe-4f84-93d7-54627ddc7ecb tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204198 Aug 09 18:06:55.521977 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 510/995] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Aug 9 18:06:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:06:55.534175 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:06:55.534800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:55.541703 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:55.542202 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:55.542641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:55.543387 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:55.543845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:55.544304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:55.676550 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:06:55.684057 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-64a27a2e-2fbd-40c5-aecb-db25f8b2db9c tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1546 microversion: 2.1 time: 0.153866 Aug 09 18:06:55.684628 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 486/996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:06:55 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:06:57.222298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caf32488-9d87-470c-b51b-78015958616b"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:06:57.224641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:06:57.231774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:57.232256 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:57.232694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:57.233381 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:06:57.233835 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:06:57.234260 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:06:57.467486 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f811bc01-2c7f-4019-a78b-f32d5c50f394 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248879 Aug 09 18:06:57.468094 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 511/997] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 9 18:06:57 2022] POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:07:05.044822 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:05.045471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:05.052136 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:05.052624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:05.053067 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:05.054738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:05.054738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:05.054738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:05.188797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:05.196736 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-83a9540b-7d77-455f-8044-c72e2cd01f98 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1592 microversion: 2.1 time: 0.156245 Aug 09 18:07:05.197319 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 487/998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:05 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1592 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:07.080467 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:07.085764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-29b19eef-9cb7-47bd-b17d-24b99025c760 req-bfcbae82-a74f-4949-8142-7a005d9b5de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eeb373-cd02-4eaf-b024-455515993714", "tag": "5429f201-caa5-4c40-bfd2-9d7fcda2385e"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:07.096720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-29b19eef-9cb7-47bd-b17d-24b99025c760 req-bfcbae82-a74f-4949-8142-7a005d9b5de2 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:07.097196 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-29b19eef-9cb7-47bd-b17d-24b99025c760 req-bfcbae82-a74f-4949-8142-7a005d9b5de2 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:07.097622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-29b19eef-9cb7-47bd-b17d-24b99025c760 req-bfcbae82-a74f-4949-8142-7a005d9b5de2 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:07.111248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-29b19eef-9cb7-47bd-b17d-24b99025c760 req-bfcbae82-a74f-4949-8142-7a005d9b5de2 service nova] Creating event network-changed:5429f201-caa5-4c40-bfd2-9d7fcda2385e for instance a9eeb373-cd02-4eaf-b024-455515993714 on hv-cinder-83608 Aug 09 18:07:07.116405 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-29b19eef-9cb7-47bd-b17d-24b99025c760 req-bfcbae82-a74f-4949-8142-7a005d9b5de2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037435 Aug 09 18:07:07.117209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 512/999] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:07:08.180982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-172762644"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:08.181518 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:08.188498 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:08.188988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:08.189525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:08.190098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:08.190553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:08.190994 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:08.319259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.network.security_group_api [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Adding security group 9cdf0a32-67fa-4004-ade1-69e2631e4750 to port 5429f201-caa5-4c40-bfd2-9d7fcda2385e Aug 09 18:07:08.640021 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b5ac3e4e-bbcb-4f41-b966-42f8df87841d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/action" status: 202 len: 0 microversion: 2.1 time: 0.463016 Aug 09 18:07:08.640633 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 488/1000] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:07:08 2022] POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:07:08.649388 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:08.650277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:08.657424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:08.658030 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:08.658576 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:08.659538 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:08.660088 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:08.660604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:08.812272 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:08.820474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05c32d34-e8c4-4957-b3c0-3e590b55e19b tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1757 microversion: 2.1 time: 0.175426 Aug 09 18:07:08.821054 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 513/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:08 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:09.134042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b2d28795-8004-4d2a-ae13-886ef5585765 req-3002f962-b4a2-4a0e-abda-6c3c22cefcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eeb373-cd02-4eaf-b024-455515993714", "tag": "5429f201-caa5-4c40-bfd2-9d7fcda2385e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:09.143803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b2d28795-8004-4d2a-ae13-886ef5585765 req-3002f962-b4a2-4a0e-abda-6c3c22cefcc9 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:09.144415 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b2d28795-8004-4d2a-ae13-886ef5585765 req-3002f962-b4a2-4a0e-abda-6c3c22cefcc9 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:09.144858 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b2d28795-8004-4d2a-ae13-886ef5585765 req-3002f962-b4a2-4a0e-abda-6c3c22cefcc9 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:09.156619 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b2d28795-8004-4d2a-ae13-886ef5585765 req-3002f962-b4a2-4a0e-abda-6c3c22cefcc9 service nova] Creating event network-changed:5429f201-caa5-4c40-bfd2-9d7fcda2385e for instance a9eeb373-cd02-4eaf-b024-455515993714 on hv-cinder-83608 Aug 09 18:07:09.161711 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b2d28795-8004-4d2a-ae13-886ef5585765 req-3002f962-b4a2-4a0e-abda-6c3c22cefcc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031605 Aug 09 18:07:09.162307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 489/1002] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:07:32.397622 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:32.399815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:32.402012 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=9 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:32.402676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:32.408573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:32.408978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:32.409403 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:32.410080 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:32.410518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:32.410931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:32.486352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-95435cfe-a196-47bf-b6ed-49d4be994464 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/action" status: 202 len: 0 microversion: 2.1 time: 0.092400 Aug 09 18:07:32.490194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 514/1003] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:07:32 2022] POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:07:32.493503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=13 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:32.494271 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=44 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:32.499325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:32.500015 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:32.507807 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:32.508313 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:32.508743 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:32.509434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:32.509884 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:32.510304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:32.660418 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:32.676189 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7666661e-dfb9-46e9-963c-8504e12c6392 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1749 microversion: 2.1 time: 0.184360 Aug 09 18:07:32.676774 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 490/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:32 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:33.698393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:33.699041 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:33.705219 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:33.705696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:33.706129 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:33.706814 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:33.707298 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:33.707724 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:33.854945 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:33.863459 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-35d73261-86ca-4cd7-a536-4e6d06b1376f tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.169752 Aug 09 18:07:33.864006 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 515/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:33 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:34.885450 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:34.886068 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:34.892765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:34.893275 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:34.893718 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:34.894420 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:34.894874 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:34.895339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:35.044773 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:35.053315 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d1334c7b-fbf2-41ed-a488-94b9b67b23cc tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.171877 Aug 09 18:07:35.053909 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 491/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:34 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:36.073680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:36.074327 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:36.080809 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:36.081291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:36.081729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:36.082420 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:36.082874 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:36.083323 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:36.221650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:36.229499 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-37c75262-cde9-4494-8b29-332a4a615bf0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.159720 Aug 09 18:07:36.230064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 516/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:36 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:37.252957 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:37.253559 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:37.261751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:37.262240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:37.262676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:37.263406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:37.264468 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:37.264899 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:37.408065 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:37.415955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9bdc6015-6330-403d-a9d4-6b0a0c3dfc02 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.167964 Aug 09 18:07:37.416528 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 492/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:37 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:38.437634 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:38.439529 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:38.444758 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:38.445238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:38.445668 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:38.446357 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:38.446805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:38.447258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:38.597373 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:38.605668 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-01b07c60-d2ad-4584-81ad-f77d3656d519 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.171975 Aug 09 18:07:38.606251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 517/1009] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:38 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:39.626919 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:39.627846 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:39.634346 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:39.634835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:39.635310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:39.636036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:39.636491 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:39.636921 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:39.788048 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:39.796901 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-84514897-08a5-4bee-917f-ce1c303b642a tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.173877 Aug 09 18:07:39.797513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 493/1010] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:39 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:40.818440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:40.819079 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:40.825571 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:40.826048 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:40.826476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:40.827764 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:40.828262 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:40.828680 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:40.973945 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:40.981858 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b3ef871d-772d-4883-bc5a-659f4dc8f332 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.167258 Aug 09 18:07:40.982418 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 518/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:40 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:42.003486 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:42.004158 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:42.010459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:42.010940 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:42.011408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:42.012097 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:42.012548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:42.012969 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:42.155082 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:42.163597 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5bab931b-346d-4fbb-a9fe-d40eeac1e285 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.164485 Aug 09 18:07:42.164165 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 494/1012] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:41 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:43.184536 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:43.185146 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:43.191625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:43.192095 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:43.192535 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:43.193201 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:43.193642 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:43.194056 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:43.339798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:43.348099 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1b75e1de-6833-4ccc-8f69-43c8ac0c2e0e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1754 microversion: 2.1 time: 0.167467 Aug 09 18:07:43.348658 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 519/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:43 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:44.369485 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:44.370103 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:44.377624 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:44.378105 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:44.378548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:44.379264 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:44.379714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:44.380137 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:44.521053 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:44.528842 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f0a204f1-3c25-4d63-848d-f77f987402a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1757 microversion: 2.1 time: 0.163329 Aug 09 18:07:44.529411 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 495/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:44 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:10.618988 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:10.619563 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:10.621630 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=12 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:10.622464 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:10.629039 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:10.629519 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:10.629947 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:10.630633 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:10.631111 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:10.631531 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:10.654527 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lazy-loading 'flavor' on Instance uuid 47c61ae7-015c-4681-ba47-07ff241ccb0f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:08:10.725595 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-40807357-ddef-4b2e-a751-2148478f0524 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "POST /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f/action" status: 202 len: 0 microversion: 2.1 time: 0.110500 Aug 09 18:08:10.726229 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 520/1015] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:08:10 2022] POST /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:08:10.734765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:10.736035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:10.738521 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=12 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:10.739200 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=36 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:10.745285 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:10.745883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:10.746297 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:10.747016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:10.747508 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:10.748003 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:10.887073 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:10.894532 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a54dc1c1-aba8-4e28-996a-14af1bc91eba tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.163758 Aug 09 18:08:10.895132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 496/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:10 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:11.916901 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:11.917641 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:11.924460 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:11.924939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:11.925374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:11.926059 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:11.926511 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:11.926931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:12.060250 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:12.067968 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dab605a2-59bd-47ad-8f1e-5f8df417cd10 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.156014 Aug 09 18:08:12.068545 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 521/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:11 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:13.089797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:13.090414 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:13.097449 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:13.097933 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:13.098371 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:13.099098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:13.099556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:13.099984 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:13.239631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:13.247228 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-46d44120-06f5-42c3-80cb-ecd98f28028d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.161439 Aug 09 18:08:13.247797 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 497/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:13 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:14.268628 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:14.269218 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:14.275676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:14.276151 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:14.276576 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:14.277256 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:14.277705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:14.278120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:14.409599 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:14.416960 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fb91954c-3995-4282-8c75-9e7e17ff0078 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.152771 Aug 09 18:08:14.417524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 522/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:14 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:15.437748 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:15.438421 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:15.444554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:15.445040 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:15.445475 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:15.446163 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:15.446615 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:15.447061 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:15.579945 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:15.587433 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5a9af557-aede-49e2-a016-9fc67152e1f0 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.153657 Aug 09 18:08:15.588019 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 498/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:15 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:16.608762 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:16.609357 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:16.616297 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:16.616774 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:16.617204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:16.617879 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:16.618328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:16.618748 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:16.757697 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:16.765132 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2e7dbbaf-943c-4c8e-abee-9429af374acd tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.160260 Aug 09 18:08:16.765700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 523/1021] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:16 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:17.652752 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-172762644"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:17.653327 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:17.659761 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:17.660240 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:17.660680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:17.661367 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:17.661816 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:17.662236 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:17.785763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:17.786261 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:17.788392 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.network.security_group_api [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Removing security group 9cdf0a32-67fa-4004-ade1-69e2631e4750 from port 5429f201-caa5-4c40-bfd2-9d7fcda2385e Aug 09 18:08:17.792763 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:17.793246 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:17.793679 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:17.794509 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:17.794959 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:17.795447 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.010644 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:18.019632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5ef195b7-231c-4b93-945c-91a3be8a6c53 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.237789 Aug 09 18:08:18.021001 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 524/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:17 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:18.189026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f1ff0e1f-02e8-41ed-a03c-8b41a9ed5cb9 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/action" status: 202 len: 0 microversion: 2.1 time: 0.539675 Aug 09 18:08:18.198069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4dfba652-fca5-4afa-9418-f231f3d41cc5 req-970f640c-18f2-4378-ac48-202dd00c946b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eeb373-cd02-4eaf-b024-455515993714", "tag": "5429f201-caa5-4c40-bfd2-9d7fcda2385e"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:18.201751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 499/1023] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:08:17 2022] POST /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:08:18.209345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4dfba652-fca5-4afa-9418-f231f3d41cc5 req-970f640c-18f2-4378-ac48-202dd00c946b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.210204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4dfba652-fca5-4afa-9418-f231f3d41cc5 req-970f640c-18f2-4378-ac48-202dd00c946b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.211140 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4dfba652-fca5-4afa-9418-f231f3d41cc5 req-970f640c-18f2-4378-ac48-202dd00c946b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.228207 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4dfba652-fca5-4afa-9418-f231f3d41cc5 req-970f640c-18f2-4378-ac48-202dd00c946b service nova] Creating event network-changed:5429f201-caa5-4c40-bfd2-9d7fcda2385e for instance a9eeb373-cd02-4eaf-b024-455515993714 on hv-cinder-83608 Aug 09 18:08:18.237269 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4dfba652-fca5-4afa-9418-f231f3d41cc5 req-970f640c-18f2-4378-ac48-202dd00c946b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043718 Aug 09 18:08:18.238376 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 525/1024] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:19.042433 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:19.043201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:19.049982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:19.050471 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:19.050907 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:19.051631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:19.052085 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:19.052512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:19.276850 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:19.284879 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-35cb4a85-fce3-4143-83ca-26a5874e924e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.246895 Aug 09 18:08:19.285526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 500/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:19 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:19.448877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:19.449461 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:19.456742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:19.457221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:19.457702 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:19.458416 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:19.458869 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:19.459317 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:19.540117 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lazy-loading 'services' on Instance uuid a9eeb373-cd02-4eaf-b024-455515993714 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:08:19.617200 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9356fe5-95f8-4868-948f-25cd80059866 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments/caf32488-9d87-470c-b51b-78015958616b" status: 202 len: 0 microversion: 2.1 time: 0.172461 Aug 09 18:08:19.617805 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 526/1026] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:08:19 2022] DELETE /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments/caf32488-9d87-470c-b51b-78015958616b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:08:19.627462 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:19.629845 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:19.636333 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:19.637158 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:19.637800 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:19.638792 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:19.639302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:19.639796 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:19.669554 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-77fa4c18-94c0-44ad-a5c6-f888b79d4487 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047173 Aug 09 18:08:19.670353 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 501/1027] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:08:19 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:20.255299 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-613d16b4-b23c-4c73-960b-7b109d0553b5 req-1d842f31-dfab-4cd0-8ee7-d5bfe0c812e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eeb373-cd02-4eaf-b024-455515993714", "tag": "5429f201-caa5-4c40-bfd2-9d7fcda2385e"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:20.265013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-613d16b4-b23c-4c73-960b-7b109d0553b5 req-1d842f31-dfab-4cd0-8ee7-d5bfe0c812e5 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.265474 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-613d16b4-b23c-4c73-960b-7b109d0553b5 req-1d842f31-dfab-4cd0-8ee7-d5bfe0c812e5 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.265903 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-613d16b4-b23c-4c73-960b-7b109d0553b5 req-1d842f31-dfab-4cd0-8ee7-d5bfe0c812e5 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.277715 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-613d16b4-b23c-4c73-960b-7b109d0553b5 req-1d842f31-dfab-4cd0-8ee7-d5bfe0c812e5 service nova] Creating event network-changed:5429f201-caa5-4c40-bfd2-9d7fcda2385e for instance a9eeb373-cd02-4eaf-b024-455515993714 on hv-cinder-83608 Aug 09 18:08:20.283424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-613d16b4-b23c-4c73-960b-7b109d0553b5 req-1d842f31-dfab-4cd0-8ee7-d5bfe0c812e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031773 Aug 09 18:08:20.284031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 527/1028] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:20.307638 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:20.308342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:20.315193 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.315717 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.316160 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.316873 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.317361 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.317932 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.452090 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:20.460340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-38847c4f-27a0-4ad0-ad02-555b34fc433d tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.156682 Aug 09 18:08:20.460943 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 502/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:20 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:20.683513 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:20.685759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:20.693224 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.693707 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.694139 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.694838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.695309 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.695740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.724536 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1a9c9af9-c8b3-49bc-a4c1-3b6d73d73da0 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Aug 09 18:08:20.725111 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 528/1030] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:08:20 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:21.482171 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:21.482948 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:21.490386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.490877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.491349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.492059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.492517 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.492946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.737918 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:21.740124 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:21.746618 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.747286 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.747715 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.748401 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.748848 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.749303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.777721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d3f3127a-25f7-453a-b38d-181a9badb8a7 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043757 Aug 09 18:08:21.778283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 529/1031] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 9 18:08:21 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:08:21.784305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:21.790077 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:21.790562 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:21.792170 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-36f4fba8-22c7-4277-a269-7d0cf1d9e9e6 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.313867 Aug 09 18:08:21.792742 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 503/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:21 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:21.796884 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.797449 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.797911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.798705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.799421 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.799703 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.872739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] HTTP exception thrown: Instance a9eeb373-cd02-4eaf-b024-455515993714 is not attached to volume caf32488-9d87-470c-b51b-78015958616b Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Request method failure captured: Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments/caf32488-9d87-470c-b51b-78015958616b HTTP/1.1 Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qIakmi57-rHbypP6PpTqLtNYrcEg_IklnSQV42CpjAJT1ukJkkv6h8ZSCMAJLcyyqmxYo6dKHjvCIc4qdEaE-CMh7SpIpj61BhB9LjnH_Fil3u9u-eTuLo4PEMkcwAdhpVM0OUmuHloHNMimQA3woXok1o1_-54QVpW_dOtOcd6zwg Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 1b9d999e96684373b7fe94b07d007eee Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestMinimumBasicScenario-874973568 Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:08:21.875109 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b9d999e96684373b7fe94b07d007eee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b9d999e96684373b7fe94b07d007eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b9d999e96684373b7fe94b07d007eee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b9d999e96684373b7fe94b07d007eee", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestMinimumBasicScenario-874973568 Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 1b9d999e96684373b7fe94b07d007eee Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874973568 Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-TestMinimumBasicScenario-874973568-project Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 83be648a00b24d7082a01c56f4317069 Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestMinimumBasicScenario-874973568-project Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:08:21.877534 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance a9eeb373-cd02-4eaf-b024-455515993714 is not attached to volume caf32488-9d87-470c-b51b-78015958616b Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'server_id': 'a9eeb373-cd02-4eaf-b024-455515993714', 'id': 'caf32488-9d87-470c-b51b-78015958616b'} Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id caf32488-9d87-470c-b51b-78015958616b. Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:08:21.878552 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eeb373-cd02-4eaf-b024-455515993714 is not attached to volume caf32488-9d87-470c-b51b-78015958616b Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eeb373-cd02-4eaf-b024-455515993714 is not attached to volume caf32488-9d87-470c-b51b-78015958616b Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.880125 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Returning 404 to user: Instance a9eeb373-cd02-4eaf-b024-455515993714 is not attached to volume caf32488-9d87-470c-b51b-78015958616b {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:08:21.881575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3781dade-55e7-41f2-94bf-016d7d4efea1 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments/caf32488-9d87-470c-b51b-78015958616b" status: 404 len: 154 microversion: 2.1 time: 0.090374 Aug 09 18:08:21.881575 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 530/1033] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 9 18:08:21 2022] DELETE /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714/os-volume_attachments/caf32488-9d87-470c-b51b-78015958616b => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:08:22.812950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:22.814052 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:22.820395 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:22.820873 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:22.821303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:22.821981 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:22.822425 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:22.822841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:22.951151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:22.959195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b7f0aedf-4dbb-4acb-b9d4-f79811608bf8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.150054 Aug 09 18:08:22.959771 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 504/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:22 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:23.024462 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:23.024943 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:23.031306 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:23.031783 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:23.032213 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:23.032890 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:23.033335 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:23.033751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:23.059082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:08:23.136158 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d1fa620d-4690-427c-a783-ca9924ae9050 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 204 len: 0 microversion: 2.1 time: 0.115303 Aug 09 18:08:23.136666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 531/1035] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:08:23 2022] DELETE /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:08:23.145751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:23.146361 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:23.152256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:23.152731 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:23.153161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:23.153837 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:23.154396 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:23.154688 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:23.285043 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:23.292447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d3659dd1-60aa-4ef7-9564-573763e7d34e tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1552 microversion: 2.1 time: 0.151199 Aug 09 18:08:23.293015 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 505/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:23 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:23.980344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:23.981078 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:23.987453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:23.987925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:23.988354 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:23.989031 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:23.989479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:23.989897 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:24.126952 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:24.134715 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-64766631-a44e-4c6b-94eb-31b6e4b29efa tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.158562 Aug 09 18:08:24.135344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 532/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:23 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:24.313412 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:24.313991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:24.320402 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:24.320891 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:24.321331 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:24.322031 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:24.322482 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:24.322904 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:24.453733 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:24.461175 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b7c6d57b-b622-41ed-bef1-5de455224abd tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1552 microversion: 2.1 time: 0.151723 Aug 09 18:08:24.461751 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 506/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:24 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:25.156025 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:25.156638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:25.163369 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:25.163853 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:25.164287 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:25.164973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:25.165424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:25.165842 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:25.184340 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:25.352562 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:25.361453 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9f4bf4c5-e3ef-4a53-8b1a-31955dd2d3ce tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.209405 Aug 09 18:08:25.362583 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 533/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:25 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:25.482956 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:25.483720 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:25.490884 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:25.491784 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:25.492151 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:25.498854 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:25.499355 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:25.499793 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:25.590767 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83be648a00b24d7082a01c56f4317069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9d999e96684373b7fe94b07d007eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:25.598512 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-079dec19-9805-4a35-ac5c-47d2e3de2696 tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 200 len: 1510 microversion: 2.1 time: 0.119825 Aug 09 18:08:25.599306 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 507/1040] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:25 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 1510 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:25.602038 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-fc4b08c1-26fd-43b6-bde6-15d1a0d8d3e4 req-5d46a4a3-ee1c-46c2-b9b4-59c1aa2d3d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eeb373-cd02-4eaf-b024-455515993714", "name": "network-vif-deleted", "tag": "5429f201-caa5-4c40-bfd2-9d7fcda2385e"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:25.612593 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fc4b08c1-26fd-43b6-bde6-15d1a0d8d3e4 req-5d46a4a3-ee1c-46c2-b9b4-59c1aa2d3d52 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:25.613118 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fc4b08c1-26fd-43b6-bde6-15d1a0d8d3e4 req-5d46a4a3-ee1c-46c2-b9b4-59c1aa2d3d52 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:25.613546 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fc4b08c1-26fd-43b6-bde6-15d1a0d8d3e4 req-5d46a4a3-ee1c-46c2-b9b4-59c1aa2d3d52 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:25.624819 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-fc4b08c1-26fd-43b6-bde6-15d1a0d8d3e4 req-5d46a4a3-ee1c-46c2-b9b4-59c1aa2d3d52 service nova] Creating event network-vif-deleted:5429f201-caa5-4c40-bfd2-9d7fcda2385e for instance a9eeb373-cd02-4eaf-b024-455515993714 on hv-cinder-83608 Aug 09 18:08:25.630738 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-fc4b08c1-26fd-43b6-bde6-15d1a0d8d3e4 req-5d46a4a3-ee1c-46c2-b9b4-59c1aa2d3d52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Aug 09 18:08:25.631408 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 534/1041] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:26.383352 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:26.383993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:26.389924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:26.390410 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:26.390846 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:26.392092 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:26.392548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:26.392973 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:26.522556 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:26.530071 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-74c75fa9-6b5a-4d9f-9aee-0327a11725d8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1509 microversion: 2.1 time: 0.150540 Aug 09 18:08:26.530649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 508/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:26 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:26.551142 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:26.551823 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:26.558786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:26.558786 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:26.559162 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:26.559740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:26.560152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:26.560797 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:26.590592 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117886) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:08:26.619399 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:26.620015 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] [instance: a9eeb373-cd02-4eaf-b024-455515993714] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:26.626469 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:26.626949 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:26.627661 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:26.628345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:26.628798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:26.629222 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:26.644140 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] HTTP exception thrown: Instance a9eeb373-cd02-4eaf-b024-455515993714 could not be found. Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Request method failure captured: Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 HTTP/1.1 Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qIakmi57-rHbypP6PpTqLtNYrcEg_IklnSQV42CpjAJT1ukJkkv6h8ZSCMAJLcyyqmxYo6dKHjvCIc4qdEaE-CMh7SpIpj61BhB9LjnH_Fil3u9u-eTuLo4PEMkcwAdhpVM0OUmuHloHNMimQA3woXok1o1_-54QVpW_dOtOcd6zwg Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 1b9d999e96684373b7fe94b07d007eee Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestMinimumBasicScenario-874973568 Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:08:26.646035 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b9d999e96684373b7fe94b07d007eee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b9d999e96684373b7fe94b07d007eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b9d999e96684373b7fe94b07d007eee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b9d999e96684373b7fe94b07d007eee", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestMinimumBasicScenario-874973568 Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 1b9d999e96684373b7fe94b07d007eee Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874973568 Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-TestMinimumBasicScenario-874973568-project Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 83be648a00b24d7082a01c56f4317069 Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestMinimumBasicScenario-874973568-project Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance a9eeb373-cd02-4eaf-b024-455515993714 could not be found. Aug 09 18:08:26.647894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'a9eeb373-cd02-4eaf-b024-455515993714'} Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eeb373-cd02-4eaf-b024-455515993714 could not be found. Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:08:26.651971 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eeb373-cd02-4eaf-b024-455515993714 could not be found. Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eeb373-cd02-4eaf-b024-455515993714 could not be found. Aug 09 18:08:26.653505 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:08:26.654902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Returning 404 to user: Instance a9eeb373-cd02-4eaf-b024-455515993714 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:08:26.654902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-97a49d0b-3c2f-434f-99b9-2040ecfd589d tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714" status: 404 len: 111 microversion: 2.1 time: 0.032008 Aug 09 18:08:26.654902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 509/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:26 2022] GET /compute/v2.1/servers/a9eeb373-cd02-4eaf-b024-455515993714 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:08:26.655484 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [3cf6491a-e7dc-425b-9f07-ddf576d88e1d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:08:26.656572 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-343e355b-5d9b-40a8-981d-feab8f6c1edf tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] Calling method '.version_select at 0x7f8c0698f940>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:26.677824 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-343e355b-5d9b-40a8-981d-feab8f6c1edf tempest-TestMinimumBasicScenario-874973568 tempest-TestMinimumBasicScenario-874973568-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1581373665" status: 202 len: 0 microversion: 2.1 time: 0.025120 Aug 09 18:08:26.678384 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 510/1044] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Aug 9 18:08:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1581373665 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:08:27.107780 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-a0904f91-80e3-47d4-b70b-182463b7149c req-f51c0de1-87e3-4a6f-9b51-39f103402188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c61ae7-015c-4681-ba47-07ff241ccb0f", "name": "network-vif-unplugged", "status": "completed", "tag": "32317f6f-aed5-46e5-940f-2b0d283ac7ed"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:27.120738 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a0904f91-80e3-47d4-b70b-182463b7149c req-f51c0de1-87e3-4a6f-9b51-39f103402188 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:27.121310 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a0904f91-80e3-47d4-b70b-182463b7149c req-f51c0de1-87e3-4a6f-9b51-39f103402188 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:27.121816 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a0904f91-80e3-47d4-b70b-182463b7149c req-f51c0de1-87e3-4a6f-9b51-39f103402188 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:27.133801 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.compute.server_external_events [req-a0904f91-80e3-47d4-b70b-182463b7149c req-f51c0de1-87e3-4a6f-9b51-39f103402188 service nova] Unable to find a host for instance 47c61ae7-015c-4681-ba47-07ff241ccb0f. Dropping event network-vif-unplugged {{(pid=117885) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:08:27.134697 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-a0904f91-80e3-47d4-b70b-182463b7149c req-f51c0de1-87e3-4a6f-9b51-39f103402188 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.102296 Aug 09 18:08:27.135325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 511/1045] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 104 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 18:08:27.663844 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [3cf6491a-e7dc-425b-9f07-ddf576d88e1d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48288. Aug 09 18:08:27.667167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ab30e4cf-b414-464b-a582-a4604f8dd89a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "POST /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f/action" status: 202 len: 0 microversion: 2.1 time: 1.120749 Aug 09 18:08:27.667981 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 535/1046] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 9 18:08:26 2022] POST /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f/action => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:08:27.676467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:27.676986 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:27.683656 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:27.684139 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:27.684765 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:27.685655 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:27.685924 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:27.686348 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:27.931983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:27.940093 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a16df3b3-09d1-4134-9a92-6824aeafa7e7 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1517 microversion: 2.1 time: 0.267737 Aug 09 18:08:27.940661 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 512/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:27 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1517 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:28.962281 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:28.963790 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:28.972065 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:28.972816 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:28.973505 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:28.974436 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:28.975283 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:28.977611 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:29.149371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:29.161424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a2d4bc4b-93de-45bb-8c7f-71959b798655 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1517 microversion: 2.1 time: 0.202047 Aug 09 18:08:29.162049 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 536/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:28 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:30.184128 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:30.185453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:30.206087 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:30.207215 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:30.207668 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:30.208468 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:30.209453 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:30.210007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:30.463700 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:30.471739 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fd4aed9f-2ed8-4ba7-8449-82996fe9dbf4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1517 microversion: 2.1 time: 0.292482 Aug 09 18:08:30.472317 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 513/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:30 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1517 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:31.493704 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:31.494321 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:31.501113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:31.501612 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:31.502048 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:31.503064 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:31.503525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:31.503954 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:31.745305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:31.753399 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a794ddb8-767b-4542-8071-59683a4f3c20 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1517 microversion: 2.1 time: 0.263625 Aug 09 18:08:31.754199 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 537/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:31 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1517 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:32.773854 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:32.774490 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:32.781293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:32.781891 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:32.782932 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:32.783737 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:32.784261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:32.784692 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:33.005526 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:33.014033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-35a42b8e-2581-42c2-9e68-56dfd9fafe38 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1519 microversion: 2.1 time: 0.244115 Aug 09 18:08:33.014747 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 514/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:32 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:34.039248 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:34.040028 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:34.047322 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:34.047810 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:34.049123 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:34.049840 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:34.050297 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:34.051914 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:34.312656 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:34.320266 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7af5830a-0c5d-48ae-bd3c-a3dbe38beb80 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.286823 Aug 09 18:08:34.320847 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 538/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:34 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:35.341989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:35.342536 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:35.349254 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:35.349741 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:35.350181 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:35.350872 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:35.351358 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:35.351788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:35.355703 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:35.484042 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:35.492166 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9d2a705a-0d1c-4a28-89dd-9351c9540402 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.154304 Aug 09 18:08:35.492736 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 515/1053] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:35 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:36.513494 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:36.514097 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:36.520750 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:36.521237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:36.521700 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:36.522395 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:36.522877 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:36.523328 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:36.658194 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:36.665671 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-63aa345b-be0d-47b4-9b26-1343e0d3981e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.155998 Aug 09 18:08:36.666268 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 539/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:36 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:37.687302 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:37.687858 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:37.694852 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:37.695374 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:37.695813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:37.696523 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:37.696979 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:37.697408 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:37.833743 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:37.841167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6a89eb45-aad7-42cb-bde8-016797b18ee8 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.158527 Aug 09 18:08:37.841735 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 516/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:37 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:38.862291 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:38.862882 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:38.869237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:38.869708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:38.870134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:38.870808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:38.871278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:38.871695 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:39.004905 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:39.012457 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-09d1861a-7824-47b3-ac0a-e24632a5276e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.154552 Aug 09 18:08:39.013027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 540/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:38 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:40.033991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:40.034780 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:40.046947 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:40.047467 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:40.048553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:40.049265 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:40.049726 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:40.050154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:40.180616 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:40.188143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-585b0e04-2aab-4f43-a316-82653e027c62 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.158876 Aug 09 18:08:40.188767 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 517/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:40 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:41.209368 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:41.209973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:41.212345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:41.218221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:41.218862 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:41.219314 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:41.219996 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:41.220440 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:41.220855 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:41.351767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:41.359185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0e957591-4404-4458-8d6a-b87914ddc12a tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.153605 Aug 09 18:08:41.359760 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 541/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:41 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:42.380884 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:42.381528 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:42.383853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:42.389944 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:42.390422 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:42.390853 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:42.391581 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:42.392025 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:42.392444 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:42.524221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:42.531682 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-863e5d5c-0d84-4a4e-97a8-395081abad0e tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.154878 Aug 09 18:08:42.532818 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 518/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:42 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:43.553917 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:43.554524 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:43.560915 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:43.561385 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:43.561808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:43.562495 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:43.562940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:43.563378 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:43.694311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:43.702045 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c92e7e30-d76f-463a-bec9-77252bfde9a4 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.151945 Aug 09 18:08:43.702574 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 542/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:43 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:44.723572 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:44.724223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:44.730303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:44.730787 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:44.731261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:44.731980 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:44.732437 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:44.732863 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:44.869768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:44.877089 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d5c88cb5-47da-4ecc-92cd-4c5e96a0179f tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.158109 Aug 09 18:08:44.877915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 519/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:44 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:45.322895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-f7f2bba4-9537-4c20-a12b-d5e44b89f5ae req-79a4750f-c8cd-4483-b15b-f14d4cdc8e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c61ae7-015c-4681-ba47-07ff241ccb0f", "name": "network-vif-plugged", "status": "completed", "tag": "32317f6f-aed5-46e5-940f-2b0d283ac7ed"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:45.334619 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f7f2bba4-9537-4c20-a12b-d5e44b89f5ae req-79a4750f-c8cd-4483-b15b-f14d4cdc8e3a service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:45.335131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f7f2bba4-9537-4c20-a12b-d5e44b89f5ae req-79a4750f-c8cd-4483-b15b-f14d4cdc8e3a service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:45.335631 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f7f2bba4-9537-4c20-a12b-d5e44b89f5ae req-79a4750f-c8cd-4483-b15b-f14d4cdc8e3a service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:45.346509 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-f7f2bba4-9537-4c20-a12b-d5e44b89f5ae req-79a4750f-c8cd-4483-b15b-f14d4cdc8e3a service nova] Creating event network-vif-plugged:32317f6f-aed5-46e5-940f-2b0d283ac7ed for instance 47c61ae7-015c-4681-ba47-07ff241ccb0f on hv-cinder-83608 Aug 09 18:08:45.351433 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-f7f2bba4-9537-4c20-a12b-d5e44b89f5ae req-79a4750f-c8cd-4483-b15b-f14d4cdc8e3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032194 Aug 09 18:08:45.352173 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 543/1062] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:45.897736 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:45.898359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:45.904871 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:45.905359 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:45.905798 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:45.906486 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:45.906943 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:45.907398 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:46.041294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:46.048861 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ae0a0fe7-64b8-4838-adbf-fec6124ace32 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1575 microversion: 2.1 time: 0.155092 Aug 09 18:08:46.049434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 520/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:45 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:47.074338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:47.075106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:47.081258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:47.081735 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:47.082802 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:47.083522 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:47.083973 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:47.084394 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:47.219476 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:47.227565 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4e7e4bc7-9818-4223-9e86-9092874cb011 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1562 microversion: 2.1 time: 0.158155 Aug 09 18:08:47.228166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 544/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:47 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:48.771629 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:48.772219 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:48.778631 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:48.779107 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:48.779548 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:48.780249 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:48.780705 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:48.781132 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:48.807951 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:08:48.882287 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-077eee8e-df44-4fcb-8ecb-49c44609615b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 204 len: 0 microversion: 2.1 time: 0.115335 Aug 09 18:08:48.882921 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 521/1065] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:08:48 2022] DELETE /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:08:48.893864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:48.893864 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:48.903578 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:48.904664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:48.905371 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:48.906785 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:48.907963 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:48.908482 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:49.038096 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:49.045539 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f0a90f1d-a154-460b-a2f4-51032d7425c1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1578 microversion: 2.1 time: 0.158333 Aug 09 18:08:49.046113 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 545/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:48 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:50.067339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:50.068052 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:50.074516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:50.075026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:50.075463 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:50.076153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:50.076601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:50.077022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:50.220646 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:50.228201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-929ee8cc-f3e2-40c8-8b06-03cab9807952 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1578 microversion: 2.1 time: 0.165172 Aug 09 18:08:50.228773 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 522/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:50 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:51.249752 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:51.250339 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:51.257082 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:51.257555 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:51.257978 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:51.258662 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:51.259131 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:51.259546 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:51.334872 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:51.343731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5c09be09-7b62-4bc7-9a9a-8400ca862454 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 200 len: 1511 microversion: 2.1 time: 0.097737 Aug 09 18:08:51.356695 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 546/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:51 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 1511 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:51.374117 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-7f4fe426-0341-4ff2-a3cf-fdd8be8b8fb7 req-5602391e-808d-48c3-80e3-b7071ceb8ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02ce720-286e-4766-8b03-92b699d90db9", "name": "network-vif-deleted", "tag": "b0bbc7cc-bbe0-4d35-a880-30f11ca8853f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:51.388685 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7f4fe426-0341-4ff2-a3cf-fdd8be8b8fb7 req-5602391e-808d-48c3-80e3-b7071ceb8ea8 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:51.389519 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7f4fe426-0341-4ff2-a3cf-fdd8be8b8fb7 req-5602391e-808d-48c3-80e3-b7071ceb8ea8 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:51.390270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7f4fe426-0341-4ff2-a3cf-fdd8be8b8fb7 req-5602391e-808d-48c3-80e3-b7071ceb8ea8 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:51.417338 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-7f4fe426-0341-4ff2-a3cf-fdd8be8b8fb7 req-5602391e-808d-48c3-80e3-b7071ceb8ea8 service nova] Creating event network-vif-deleted:b0bbc7cc-bbe0-4d35-a880-30f11ca8853f for instance d02ce720-286e-4766-8b03-92b699d90db9 on hv-cinder-83608 Aug 09 18:08:51.425277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-7f4fe426-0341-4ff2-a3cf-fdd8be8b8fb7 req-5602391e-808d-48c3-80e3-b7071ceb8ea8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057754 Aug 09 18:08:51.427403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 523/1069] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:52.365731 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:52.366345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:52.372413 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:52.372894 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:52.373331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:52.374018 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:52.374473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:52.374896 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:52.388530 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] HTTP exception thrown: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Request method failure captured: Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 HTTP/1.1 Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qIGKF7S_bf4Fmkw5iuHXcM1mGifF0ovhvMODr1hQlA6j6oxcqBMxi-F00l_u8jaiK8w4D1-OiN1JJwKDWNiOZQw6KLs26PR9duhOFSJAtG5X5prja2-WsHlqycWhKxJyqdffHnPiSIgLRCjkZMn87_ICTMzk_uwrASHWOGczxrXBmc Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:08:52.390167 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4821ddb8e299400eba9adc4bc53ebe6b", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 8bf28be46c9c4d9c9f5a7c5837545fa4 Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:08:52.391940 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'd02ce720-286e-4766-8b03-92b699d90db9'} Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:08:52.392955 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:08:52.395120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:08:52.396568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Returning 404 to user: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:08:52.396568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d28d03d9-b86a-415b-a418-d8f203e4f4ce tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 404 len: 111 microversion: 2.1 time: 0.029773 Aug 09 18:08:52.397070 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 547/1070] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:52 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:08:52.493745 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2002464167", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-873891623", "security_groups": [{"name": "tempest-secgroup-smoke-487061353"}], "block_device_mapping_v2": [{"uuid": "e328feb4-0de4-43ed-acb1-efa70ede52b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "648dec17-b3e5-45a9-93fb-a5a15bae0307"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:52.610011 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] validate_networks() for [('648dec17-b3e5-45a9-93fb-a5a15bae0307', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:08:53.329557 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:08:53.329983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:08:53.330454 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:08:53.330863 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:08:53.331304 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:08:53.340537 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:53.341016 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:53.341447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:53.342168 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:53.342617 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:53.343063 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:53.359854 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:08:53.363772 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for user 8bf28be46c9c4d9c9f5a7c5837545fa4 and project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:08:53.419612 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:08:53.421768 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e328feb4-0de4-43ed-acb1-efa70ede52b2',volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:08:53.551340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c8ac1158-c3bf-48a8-9750-9f00b8f3d241 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.063251 Aug 09 18:08:53.556406 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 524/1071] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:08:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:08:53.563047 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8704ff08-7950-43ef-9f56-69783528f0a8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:53.563808 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8704ff08-7950-43ef-9f56-69783528f0a8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:53.617962 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8704ff08-7950-43ef-9f56-69783528f0a8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:53.624676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8704ff08-7950-43ef-9f56-69783528f0a8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1094 microversion: 2.1 time: 0.065557 Aug 09 18:08:53.625274 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 548/1072] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:53 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:54.646476 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:54.647255 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:54.653617 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:54.654125 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:54.654714 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:54.655456 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:54.655915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:54.656342 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:54.735307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:54.743679 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-620afb0f-ca7e-49c6-9221-74a52212994a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1210 microversion: 2.1 time: 0.101817 Aug 09 18:08:54.744258 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 525/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:54 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:55.765682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:55.766278 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:55.774003 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:55.774537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:55.775115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:55.775931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:55.776410 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:55.776833 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:55.782417 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:55.799356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-647afc41-ad6d-405c-b8c4-a149b0edfeaf req-40b68faa-9fd2-4600-b8fe-a1d883643dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1", "tag": "8540d200-46e5-4cb0-8416-39bc5a9a72d2"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:55.812662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-647afc41-ad6d-405c-b8c4-a149b0edfeaf req-40b68faa-9fd2-4600-b8fe-a1d883643dad service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:55.813417 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-647afc41-ad6d-405c-b8c4-a149b0edfeaf req-40b68faa-9fd2-4600-b8fe-a1d883643dad service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:55.814148 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-647afc41-ad6d-405c-b8c4-a149b0edfeaf req-40b68faa-9fd2-4600-b8fe-a1d883643dad service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:55.826050 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-647afc41-ad6d-405c-b8c4-a149b0edfeaf req-40b68faa-9fd2-4600-b8fe-a1d883643dad service nova] Creating event network-changed:8540d200-46e5-4cb0-8416-39bc5a9a72d2 for instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 on hv-cinder-83608 Aug 09 18:08:55.831276 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-647afc41-ad6d-405c-b8c4-a149b0edfeaf req-40b68faa-9fd2-4600-b8fe-a1d883643dad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037418 Aug 09 18:08:55.831881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 526/1074] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:56.047580 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:56.055106 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-329c226d-dde5-460e-b183-715a89063f85 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.293287 Aug 09 18:08:56.055686 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 549/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:55 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:57.077265 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:57.078033 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:57.084178 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:57.084667 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:57.085110 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:57.085803 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:57.086257 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:57.086680 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:57.219341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:57.227254 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4a1b8cee-c836-46e7-a960-0cb1409d6be5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.154861 Aug 09 18:08:57.227821 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 527/1076] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:57 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:58.248518 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:58.249134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:58.255767 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:58.256242 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:58.256666 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:58.257347 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:58.257794 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:58.258214 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:58.386115 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:58.393617 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3460c703-2653-4431-af4a-6bdcb9e6d0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.148969 Aug 09 18:08:58.394185 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 550/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:58 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:59.415594 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:59.416195 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:59.422585 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:59.423093 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:59.423525 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:59.424205 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:59.424650 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:59.425069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:59.552814 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:59.560341 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-35b4d189-0d96-4611-a7e5-e8f390579c6f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.148581 Aug 09 18:08:59.560917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 528/1078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:59 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:00.581015 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:00.581624 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:00.588359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:00.588841 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:00.589273 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:00.589964 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:00.590446 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:00.590870 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:00.722122 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:00.730170 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-820353cc-70a2-48a3-a762-de9cb8119f09 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.153022 Aug 09 18:09:00.730742 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 551/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:00 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:01.751303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:01.751881 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:01.758993 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:01.759487 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:01.759926 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:01.760607 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:01.761059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:01.761481 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:01.892762 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:01.900806 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cab07fb5-278c-44a4-a4f3-c129ea8560bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.153468 Aug 09 18:09:01.901375 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 529/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:01 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:02.921635 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:02.922240 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:02.929127 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:02.929600 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:02.930027 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:02.930705 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:02.931193 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:02.931607 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:03.064023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:03.072102 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9f4f6502-5ce8-4a0d-b48d-b234fe852691 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.154261 Aug 09 18:09:03.072676 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 552/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:02 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:04.092502 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:04.093114 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:04.095547 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:04.096373 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:04.102142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:04.102627 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:04.103157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:04.103850 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:04.104303 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:04.104730 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:04.239271 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:04.246654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b5984c79-56ae-4c58-a024-b0db01d46598 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.157997 Aug 09 18:09:04.247250 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 530/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:04 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:05.268142 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:05.268739 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:05.271221 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:05.277343 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:05.277818 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:05.278244 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:05.278961 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:05.279429 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:05.279846 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:05.417448 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:05.424909 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-90b65ba3-8362-4c52-8a57-d7ffcb8ff86f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.160841 Aug 09 18:09:05.425483 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 553/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:05 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:06.446403 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:06.447047 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:06.453515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:06.453992 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:06.454428 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:06.455145 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:06.455601 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:06.456022 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:06.459212 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:06.595459 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:06.603067 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-612aecfb-551d-43ad-85dd-71994201b437 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.160677 Aug 09 18:09:06.603642 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 531/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:06 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:07.259135 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-9b70180f-274f-48be-af34-4003957755fb req-8faf791f-1f2b-49df-b380-b97f32b9044e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1", "name": "network-vif-plugged", "status": "completed", "tag": "8540d200-46e5-4cb0-8416-39bc5a9a72d2"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:07.269134 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9b70180f-274f-48be-af34-4003957755fb req-8faf791f-1f2b-49df-b380-b97f32b9044e service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:07.270403 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9b70180f-274f-48be-af34-4003957755fb req-8faf791f-1f2b-49df-b380-b97f32b9044e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:07.270836 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9b70180f-274f-48be-af34-4003957755fb req-8faf791f-1f2b-49df-b380-b97f32b9044e service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:07.282087 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-9b70180f-274f-48be-af34-4003957755fb req-8faf791f-1f2b-49df-b380-b97f32b9044e service nova] Creating event network-vif-plugged:8540d200-46e5-4cb0-8416-39bc5a9a72d2 for instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 on hv-cinder-83608 Aug 09 18:09:07.287548 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-9b70180f-274f-48be-af34-4003957755fb req-8faf791f-1f2b-49df-b380-b97f32b9044e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032051 Aug 09 18:09:07.288265 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 554/1085] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:07.624293 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:07.624909 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:07.632261 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:07.632746 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:07.633187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:07.633879 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:07.634333 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:07.634762 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:07.769207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:07.777208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4d294f96-5ce1-4776-84fd-55fd62a3d7c2 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.156778 Aug 09 18:09:07.777779 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 532/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:07 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:08.798687 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:08.799669 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:08.806838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:08.807342 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:08.807772 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:08.808458 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:08.808909 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:08.809326 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:08.940665 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:08.948156 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a8169d7a-4368-425d-8192-bdf80748a87f tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1265 microversion: 2.1 time: 0.154159 Aug 09 18:09:08.948729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 555/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:08 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:09.970144 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:09.970757 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:09.977696 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:09.978187 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:09.978654 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:09.979386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:09.979841 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:09.980271 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:10.138346 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:10.146918 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-282eb0d5-05d8-4717-85ef-61ea7c37ae62 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1453 microversion: 2.1 time: 0.181130 Aug 09 18:09:10.147589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 533/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:09 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:10.168589 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:10.169208 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:10.175759 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:10.176625 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:10.177442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:10.178568 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:10.179069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:10.179507 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:10.320237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:10.327863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-77446a37-5c4f-4866-890a-d7aff031b327 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1453 microversion: 2.1 time: 0.164228 Aug 09 18:09:10.328430 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 556/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:10 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:12.183503 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-14549292-2145-43b3-b11a-a32ce434480c req-01d55ea3-62c8-4ff1-89b9-c9cee86af972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1", "tag": "8540d200-46e5-4cb0-8416-39bc5a9a72d2"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:12.194023 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-14549292-2145-43b3-b11a-a32ce434480c req-01d55ea3-62c8-4ff1-89b9-c9cee86af972 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:12.194515 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-14549292-2145-43b3-b11a-a32ce434480c req-01d55ea3-62c8-4ff1-89b9-c9cee86af972 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:12.195036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-14549292-2145-43b3-b11a-a32ce434480c req-01d55ea3-62c8-4ff1-89b9-c9cee86af972 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:12.206203 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-14549292-2145-43b3-b11a-a32ce434480c req-01d55ea3-62c8-4ff1-89b9-c9cee86af972 service nova] Creating event network-changed:8540d200-46e5-4cb0-8416-39bc5a9a72d2 for instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 on hv-cinder-83608 Aug 09 18:09:12.212032 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-14549292-2145-43b3-b11a-a32ce434480c req-01d55ea3-62c8-4ff1-89b9-c9cee86af972 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032168 Aug 09 18:09:12.212651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 534/1090] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:10:06.769511 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:06.770159 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:06.770545 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=19 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:06.770645 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:06.773604 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=33 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:06.774352 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-192d4e99-a039-4223-9188-d7a6f3dc6268 req-5c299b0f-51ee-485f-95b2-62ed255d81b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c61ae7-015c-4681-ba47-07ff241ccb0f", "tag": "32317f6f-aed5-46e5-940f-2b0d283ac7ed"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:06.775045 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=43 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:06.781711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:06.782204 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:06.782638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:06.783372 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:06.783834 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:06.784497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:06.786307 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-192d4e99-a039-4223-9188-d7a6f3dc6268 req-5c299b0f-51ee-485f-95b2-62ed255d81b1 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:06.787201 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-192d4e99-a039-4223-9188-d7a6f3dc6268 req-5c299b0f-51ee-485f-95b2-62ed255d81b1 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:06.787641 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-192d4e99-a039-4223-9188-d7a6f3dc6268 req-5c299b0f-51ee-485f-95b2-62ed255d81b1 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:06.800644 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-192d4e99-a039-4223-9188-d7a6f3dc6268 req-5c299b0f-51ee-485f-95b2-62ed255d81b1 service nova] Creating event network-changed:32317f6f-aed5-46e5-940f-2b0d283ac7ed for instance 47c61ae7-015c-4681-ba47-07ff241ccb0f on hv-cinder-83608 Aug 09 18:10:06.807018 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-192d4e99-a039-4223-9188-d7a6f3dc6268 req-5c299b0f-51ee-485f-95b2-62ed255d81b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038948 Aug 09 18:10:06.807859 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 535/1091] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:10:06.813419 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:10:06.911989 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d60ef30b-9af2-47c7-bfc5-fc83efb404db tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "DELETE /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 204 len: 0 microversion: 2.1 time: 0.146356 Aug 09 18:10:06.912895 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 557/1092] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:10:06 2022] DELETE /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:10:06.922501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:06.923235 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:06.929651 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:06.930143 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:06.930579 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:06.931349 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:06.931805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:06.932229 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:07.093635 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:07.101161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-eda5d8e7-11c3-432c-b77d-98c467806794 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.183046 Aug 09 18:10:07.101786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 536/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:06 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:08.123008 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:08.123708 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:08.130311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.130782 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.131231 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.131906 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.132346 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.132757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.270020 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:08.279553 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc3c5564-46dc-40cd-b917-980a47166947 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1568 microversion: 2.1 time: 0.161505 Aug 09 18:10:08.280141 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 558/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:08 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:09.300729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:09.301372 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:09.307996 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:09.308983 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:09.309432 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:09.310138 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:09.310676 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:09.311049 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:09.381540 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8ef87496bb43d1bab7c5f6f101d6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b4958df154416a820335d272cec49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:09.389775 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-22a9ffd3-fa5f-494e-ba1f-f84843ee4f35 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 200 len: 1382 microversion: 2.1 time: 0.092843 Aug 09 18:10:09.390610 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 537/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:09 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 1382 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:09.392582 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-f8e3c35f-83da-4bcf-9598-0c9e947c5a99 req-a39e39a7-6d5b-4082-b368-295f32b2789d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c61ae7-015c-4681-ba47-07ff241ccb0f", "name": "network-vif-deleted", "tag": "32317f6f-aed5-46e5-940f-2b0d283ac7ed"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:09.403902 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f8e3c35f-83da-4bcf-9598-0c9e947c5a99 req-a39e39a7-6d5b-4082-b368-295f32b2789d service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:09.404441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f8e3c35f-83da-4bcf-9598-0c9e947c5a99 req-a39e39a7-6d5b-4082-b368-295f32b2789d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:09.404934 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f8e3c35f-83da-4bcf-9598-0c9e947c5a99 req-a39e39a7-6d5b-4082-b368-295f32b2789d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:09.418387 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-f8e3c35f-83da-4bcf-9598-0c9e947c5a99 req-a39e39a7-6d5b-4082-b368-295f32b2789d service nova] Creating event network-vif-deleted:32317f6f-aed5-46e5-940f-2b0d283ac7ed for instance 47c61ae7-015c-4681-ba47-07ff241ccb0f on hv-cinder-83608 Aug 09 18:10:09.423860 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-f8e3c35f-83da-4bcf-9598-0c9e947c5a99 req-a39e39a7-6d5b-4082-b368-295f32b2789d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035011 Aug 09 18:10:09.424459 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 559/1096] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:10.414153 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:10.414771 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [instance: 47c61ae7-015c-4681-ba47-07ff241ccb0f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:10.421911 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:10.422393 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:10.422835 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:10.423553 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:10.424147 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:10.424583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:10.442146 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] HTTP exception thrown: Instance 47c61ae7-015c-4681-ba47-07ff241ccb0f could not be found. Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Request method failure captured: Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f HTTP/1.1 Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qHOgXgRaElec1cqQ1Iseu8BMbWt7YlYJcClfbIYw61_l1wjURnT4S15uiA1JJq-HzVVAa5bJ7h688sOwHaBzeO0L5Xz1Jxu1L1-K_k9lnIpjjMvpCBM8wNkDAdHHiCiP5wATO2OTfRHmGRmtLNStOv6Lz2PD595hNgxrDEj8_Ubg8w Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: d6b4958df154416a820335d272cec49d Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestShelveInstance-1136394955 Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:10:10.443839 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6b4958df154416a820335d272cec49d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b4958df154416a820335d272cec49d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b4958df154416a820335d272cec49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6b4958df154416a820335d272cec49d", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestShelveInstance-1136394955 Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: d6b4958df154416a820335d272cec49d Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestShelveInstance-1136394955 Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-TestShelveInstance-1136394955-project Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 8f8ef87496bb43d1bab7c5f6f101d6aa Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestShelveInstance-1136394955-project Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance 47c61ae7-015c-4681-ba47-07ff241ccb0f could not be found. Aug 09 18:10:10.446164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': '47c61ae7-015c-4681-ba47-07ff241ccb0f'} Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c61ae7-015c-4681-ba47-07ff241ccb0f could not be found. Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:10:10.447311 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c61ae7-015c-4681-ba47-07ff241ccb0f could not be found. Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c61ae7-015c-4681-ba47-07ff241ccb0f could not be found. Aug 09 18:10:10.448946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:10:10.450708 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Returning 404 to user: Instance 47c61ae7-015c-4681-ba47-07ff241ccb0f could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:10:10.450708 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6af23975-6c57-4ce0-9777-5a253e5376d5 tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f" status: 404 len: 111 microversion: 2.1 time: 0.035041 Aug 09 18:10:10.450708 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 538/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:10 2022] GET /compute/v2.1/servers/47c61ae7-015c-4681-ba47-07ff241ccb0f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:10:10.605424 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-64c083e5-a3b3-4d6d-b886-1ccef73f581c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] Calling method '.version_select at 0x7f8c0aff1550>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:10.609840 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64c083e5-a3b3-4d6d-b886-1ccef73f581c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [63b472cd-4a96-48c3-a1f8-5d2e5eddffdb] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:10:11.616988 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [None req-64c083e5-a3b3-4d6d-b886-1ccef73f581c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] [63b472cd-4a96-48c3-a1f8-5d2e5eddffdb] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48516. Aug 09 18:10:11.635775 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-64c083e5-a3b3-4d6d-b886-1ccef73f581c tempest-TestShelveInstance-1136394955 tempest-TestShelveInstance-1136394955-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-707777160" status: 202 len: 0 microversion: 2.1 time: 1.035666 Aug 09 18:10:11.636359 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 560/1098] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 9 18:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-707777160 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:10:48.286069 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1193647783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-873891623", "security_groups": [{"name": "tempest-secgroup-smoke-487061353"}], "block_device_mapping_v2": [{"uuid": "6ac46fe2-65a3-44b3-910a-e535a50a4677", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "648dec17-b3e5-45a9-93fb-a5a15bae0307"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:48.296270 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=8 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:48.296917 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=16 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:48.399176 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] validate_networks() for [('648dec17-b3e5-45a9-93fb-a5a15bae0307', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:10:48.765955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:10:48.766388 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:10:48.766886 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:10:48.767319 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:10:48.767727 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:10:48.777294 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:48.778281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:48.778716 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:48.779457 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:48.779906 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:48.780325 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:48.797276 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:10:48.801321 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Getting quotas for user 8bf28be46c9c4d9c9f5a7c5837545fa4 and project 4821ddb8e299400eba9adc4bc53ebe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:10:48.857669 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:10:48.859847 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ac46fe2-65a3-44b3-910a-e535a50a4677',volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:10:48.985568 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c1071d61-eea6-4e13-ad2a-cc9c651ae18a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703567 Aug 09 18:10:48.986226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 539/1099] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 9 18:10:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:10:48.997202 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a516030-1018-48cc-a340-de47fce97d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:48.997939 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a516030-1018-48cc-a340-de47fce97d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:49.002186 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:49.003126 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:49.057751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a516030-1018-48cc-a340-de47fce97d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:49.064678 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a516030-1018-48cc-a340-de47fce97d21 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1094 microversion: 2.1 time: 0.071385 Aug 09 18:10:49.065258 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 561/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:48 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:50.087339 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:50.088141 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:50.095289 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:50.095788 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:50.096221 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:50.096932 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:50.097383 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:50.098110 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:50.169140 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:50.177957 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8c4aeba4-b55a-466d-886f-e5e16e9682c6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1210 microversion: 2.1 time: 0.095974 Aug 09 18:10:50.178769 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 540/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:50 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:51.205235 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:51.205235 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:51.210640 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:51.211307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:51.211740 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:51.212442 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:51.212886 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:51.213305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:51.358962 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-aecdfbf4-5298-4c56-828f-27044571a187 req-5ef41f02-01b7-4aaf-b9d7-68532b8d3ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1304d38-6181-47fb-b10e-a68e55799544", "tag": "90e3dc5a-1ecc-4954-a00a-de139f9fb5e8"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:51.364692 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:51.373036 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aecdfbf4-5298-4c56-828f-27044571a187 req-5ef41f02-01b7-4aaf-b9d7-68532b8d3ea4 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:51.374134 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aecdfbf4-5298-4c56-828f-27044571a187 req-5ef41f02-01b7-4aaf-b9d7-68532b8d3ea4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:51.374608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aecdfbf4-5298-4c56-828f-27044571a187 req-5ef41f02-01b7-4aaf-b9d7-68532b8d3ea4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:51.376190 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4153d5b6-f41b-4f76-b8a9-bd0505d0aee5 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.179792 Aug 09 18:10:51.377013 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 562/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:51 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:51.388915 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-aecdfbf4-5298-4c56-828f-27044571a187 req-5ef41f02-01b7-4aaf-b9d7-68532b8d3ea4 service nova] Creating event network-changed:90e3dc5a-1ecc-4954-a00a-de139f9fb5e8 for instance d1304d38-6181-47fb-b10e-a68e55799544 on hv-cinder-83608 Aug 09 18:10:51.395744 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-aecdfbf4-5298-4c56-828f-27044571a187 req-5ef41f02-01b7-4aaf-b9d7-68532b8d3ea4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041217 Aug 09 18:10:51.396356 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 541/1103] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:10:52.399209 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:52.399827 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:52.406193 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:52.406682 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:52.407151 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:52.407843 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:52.408303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:52.408729 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:52.539857 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:52.547915 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-889aaead-9840-410e-833b-89b619000dc3 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.152623 Aug 09 18:10:52.548494 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 563/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:52 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:53.570174 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:53.570869 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:53.576960 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:53.577437 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:53.577866 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:53.578543 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:53.579007 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:53.579431 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:53.711198 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:53.718902 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-02966653-8b5e-4786-aa50-28e11fd79f0a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.153323 Aug 09 18:10:53.719510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 542/1105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:53 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:54.740303 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:54.740921 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:54.748120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:54.748598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:54.749029 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:54.749721 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:54.750170 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:54.750588 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:54.892446 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:54.900150 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-02dade95-7c75-4b4d-99b8-983b27d32d0b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.163724 Aug 09 18:10:54.900728 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 564/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:54 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:55.922223 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:55.922860 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:55.929434 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.929913 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.930345 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.931061 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.931510 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.931927 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:56.068161 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:56.076079 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b1f2434e-14b4-485b-8b60-6eb1ed6c1c99 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.158856 Aug 09 18:10:56.076643 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 543/1107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:55 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:57.096637 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:57.097251 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:57.103757 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:57.104237 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:57.104672 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:57.105360 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:57.105812 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:57.106235 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:57.241859 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:57.249305 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd546dbb-a58a-443c-ac83-7921afac96f8 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.156567 Aug 09 18:10:57.249863 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 565/1108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:57 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:58.270941 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:58.271583 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:58.278559 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.279074 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.279516 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.280211 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.280667 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.281094 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.413169 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:58.424972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ec91c50-04bb-42d9-8a2f-ea6e8e6875e6 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.156240 Aug 09 18:10:58.424972 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 544/1109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:58 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:59.445478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:59.446253 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:59.448000 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:59.453393 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.453875 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.454307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.455023 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.455478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.455898 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.596709 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:59.604344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fd83de9-7843-40d7-b3aa-a53837f040eb tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.162853 Aug 09 18:10:59.604933 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 566/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:59 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:00.625550 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:00.626164 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:00.628513 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:11:00.629256 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:11:00.636118 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:00.636599 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:00.637626 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:00.638320 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:00.638772 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:00.639226 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:00.781108 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:00.788400 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0ea3e8d8-a4ea-4f9c-b576-6f0cf26c0da0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.167382 Aug 09 18:11:00.788955 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 545/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:00 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:01.809741 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:01.810374 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:01.817146 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:01.817632 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:01.818070 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:01.818779 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:01.819266 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:01.819692 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:01.896098 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-ecb6e971-de65-4383-b147-dbaab551e7ce req-c7ff88f0-b3ef-4f79-880e-2fb4de6d3db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1304d38-6181-47fb-b10e-a68e55799544", "name": "network-vif-plugged", "status": "completed", "tag": "90e3dc5a-1ecc-4954-a00a-de139f9fb5e8"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:01.907795 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ecb6e971-de65-4383-b147-dbaab551e7ce req-c7ff88f0-b3ef-4f79-880e-2fb4de6d3db3 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:01.908282 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ecb6e971-de65-4383-b147-dbaab551e7ce req-c7ff88f0-b3ef-4f79-880e-2fb4de6d3db3 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:01.908710 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ecb6e971-de65-4383-b147-dbaab551e7ce req-c7ff88f0-b3ef-4f79-880e-2fb4de6d3db3 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:01.921473 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-ecb6e971-de65-4383-b147-dbaab551e7ce req-c7ff88f0-b3ef-4f79-880e-2fb4de6d3db3 service nova] Creating event network-vif-plugged:90e3dc5a-1ecc-4954-a00a-de139f9fb5e8 for instance d1304d38-6181-47fb-b10e-a68e55799544 on hv-cinder-83608 Aug 09 18:11:01.926740 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-ecb6e971-de65-4383-b147-dbaab551e7ce req-c7ff88f0-b3ef-4f79-880e-2fb4de6d3db3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034539 Aug 09 18:11:01.927455 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 546/1112] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:11:01.957780 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:01.965811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5967425e-e59a-4fab-900c-40d12bdbf0d9 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.160362 Aug 09 18:11:01.966259 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 567/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:01 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:02.987759 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:02.988460 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:02.994855 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:02.995368 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:02.996621 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:02.997357 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:02.997829 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:02.998269 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:03.132451 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:03.139946 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3c2b9359-1968-4889-9290-b85d668446da tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1265 microversion: 2.1 time: 0.156854 Aug 09 18:11:03.140514 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 547/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:02 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:04.282069 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:04.282691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:04.288638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:04.289120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:04.289553 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:04.290239 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:04.290696 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:04.291152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:04.421725 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:04.429126 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fe23ac2e-a195-48af-9a29-760711a3def1 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1452 microversion: 2.1 time: 0.271600 Aug 09 18:11:04.429694 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 568/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:04 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1452 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:04.450277 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:04.450894 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:04.457322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:04.457809 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:04.458248 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:04.458989 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:04.459452 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:04.459879 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:04.590439 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:04.598034 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6d5a5239-c3b2-4737-9230-c34083a5c508 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1452 microversion: 2.1 time: 0.152248 Aug 09 18:11:04.598603 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 548/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:04 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:06.442478 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-44bbc4ad-b27a-4fad-96eb-9e19f4d25624 req-4ad340ab-685d-48ed-89b8-51b8f4c98921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1304d38-6181-47fb-b10e-a68e55799544", "tag": "90e3dc5a-1ecc-4954-a00a-de139f9fb5e8"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:06.452241 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-44bbc4ad-b27a-4fad-96eb-9e19f4d25624 req-4ad340ab-685d-48ed-89b8-51b8f4c98921 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:06.452722 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-44bbc4ad-b27a-4fad-96eb-9e19f4d25624 req-4ad340ab-685d-48ed-89b8-51b8f4c98921 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:06.453152 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-44bbc4ad-b27a-4fad-96eb-9e19f4d25624 req-4ad340ab-685d-48ed-89b8-51b8f4c98921 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:06.464532 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-44bbc4ad-b27a-4fad-96eb-9e19f4d25624 req-4ad340ab-685d-48ed-89b8-51b8f4c98921 service nova] Creating event network-changed:90e3dc5a-1ecc-4954-a00a-de139f9fb5e8 for instance d1304d38-6181-47fb-b10e-a68e55799544 on hv-cinder-83608 Aug 09 18:11:06.469838 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-44bbc4ad-b27a-4fad-96eb-9e19f4d25624 req-4ad340ab-685d-48ed-89b8-51b8f4c98921 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031133 Aug 09 18:11:06.470441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 569/1117] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:11:20.254744 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 09 18:11:25.817616 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 09 18:12:46.245988 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08d4e24c-f4df-4344-ac78-d9279f4e64cd] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 18:12:46.246786 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:46.247649 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=48 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:46.249638 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=20 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:46.250344 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=44 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:46.251386 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:46.251880 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:46.271154 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:46.272504 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:46.272947 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:46.273766 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:46.274234 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:46.274728 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:46.305117 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:12:46.314181 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-2dddaf21-6ad3-47e0-8973-90ff371410a2 req-ec0e85d2-41b5-46cf-96fe-67804ab0c44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1304d38-6181-47fb-b10e-a68e55799544", "tag": "90e3dc5a-1ecc-4954-a00a-de139f9fb5e8"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:46.324842 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2dddaf21-6ad3-47e0-8973-90ff371410a2 req-ec0e85d2-41b5-46cf-96fe-67804ab0c44d service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:46.325573 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2dddaf21-6ad3-47e0-8973-90ff371410a2 req-ec0e85d2-41b5-46cf-96fe-67804ab0c44d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:46.326006 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2dddaf21-6ad3-47e0-8973-90ff371410a2 req-ec0e85d2-41b5-46cf-96fe-67804ab0c44d service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:46.338302 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-2dddaf21-6ad3-47e0-8973-90ff371410a2 req-ec0e85d2-41b5-46cf-96fe-67804ab0c44d service nova] Creating event network-changed:90e3dc5a-1ecc-4954-a00a-de139f9fb5e8 for instance d1304d38-6181-47fb-b10e-a68e55799544 on hv-cinder-83608 Aug 09 18:12:46.344479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-2dddaf21-6ad3-47e0-8973-90ff371410a2 req-ec0e85d2-41b5-46cf-96fe-67804ab0c44d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095572 Aug 09 18:12:46.344479 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 570/1118] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:12:46.400099 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-14c8e478-26e8-4ba6-8aaa-e44bc7abc50a tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 204 len: 0 microversion: 2.1 time: 0.154077 Aug 09 18:12:46.400099 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 549/1119] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:12:46 2022] DELETE /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:12:46.408206 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:46.408909 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:46.416121 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:46.416811 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:46.417238 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:46.417937 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:46.418384 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:46.418803 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:46.614177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:46.622362 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9df21389-feac-493e-8649-95f8b2545c18 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1576 microversion: 2.1 time: 0.218233 Aug 09 18:12:46.624132 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 571/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:46 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:47.644813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:47.645524 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:47.654281 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:47.654770 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:47.655235 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:47.655991 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:47.656448 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:47.656877 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:47.663123 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] [08d4e24c-f4df-4344-ac78-d9279f4e64cd] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48706. Aug 09 18:12:47.843059 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:47.850632 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-addb372c-c318-4ab3-8755-5130a1a606bf tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1576 microversion: 2.1 time: 0.210034 Aug 09 18:12:47.851235 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 550/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:47 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:12:48.668931 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-bf9c37a1-9eed-4c4e-9a93-21f9c0ac960c req-c40dfde4-f93a-4c85-8edf-ceadd08a574b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1304d38-6181-47fb-b10e-a68e55799544", "name": "network-vif-deleted", "tag": "90e3dc5a-1ecc-4954-a00a-de139f9fb5e8"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:48.679754 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-bf9c37a1-9eed-4c4e-9a93-21f9c0ac960c req-c40dfde4-f93a-4c85-8edf-ceadd08a574b service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:48.680227 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-bf9c37a1-9eed-4c4e-9a93-21f9c0ac960c req-c40dfde4-f93a-4c85-8edf-ceadd08a574b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:48.680643 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-bf9c37a1-9eed-4c4e-9a93-21f9c0ac960c req-c40dfde4-f93a-4c85-8edf-ceadd08a574b service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:48.691941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-bf9c37a1-9eed-4c4e-9a93-21f9c0ac960c req-c40dfde4-f93a-4c85-8edf-ceadd08a574b service nova] Creating event network-vif-deleted:90e3dc5a-1ecc-4954-a00a-de139f9fb5e8 for instance d1304d38-6181-47fb-b10e-a68e55799544 on hv-cinder-83608 Aug 09 18:12:48.697043 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-bf9c37a1-9eed-4c4e-9a93-21f9c0ac960c req-c40dfde4-f93a-4c85-8edf-ceadd08a574b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031718 Aug 09 18:12:48.699153 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 572/1122] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:12:48.871782 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:48.872450 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:48.879167 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:48.879595 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:48.880026 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:48.881269 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:48.881269 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:48.881691 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:48.953754 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:48.963029 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fa1e859b-5a6c-4198-bd59-56dec94cd967 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 200 len: 1225 microversion: 2.1 time: 0.094974 Aug 09 18:12:48.963978 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 551/1123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:48 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:12:49.985809 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:49.986525 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d1304d38-6181-47fb-b10e-a68e55799544] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:49.993282 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:49.993753 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:49.994177 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:49.994852 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:49.995338 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:49.995752 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:50.008856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] HTTP exception thrown: Instance d1304d38-6181-47fb-b10e-a68e55799544 could not be found. Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Request method failure captured: Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 HTTP/1.1 Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qIGKF7S_bf4Fmkw5iuHXcM1mGifF0ovhvMODr1hQlA6j6oxcqBMxi-F00l_u8jaiK8w4D1-OiN1JJwKDWNiOZQw6KLs26PR9duhOFSJAtG5X5prja2-WsHlqycWhKxJyqdffHnPiSIgLRCjkZMn87_ICTMzk_uwrASHWOGczxrXBmc Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:12:50.010428 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4821ddb8e299400eba9adc4bc53ebe6b", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 8bf28be46c9c4d9c9f5a7c5837545fa4 Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance d1304d38-6181-47fb-b10e-a68e55799544 could not be found. Aug 09 18:12:50.012815 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'd1304d38-6181-47fb-b10e-a68e55799544'} Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1304d38-6181-47fb-b10e-a68e55799544 could not be found. Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:12:50.014438 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1304d38-6181-47fb-b10e-a68e55799544 could not be found. Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1304d38-6181-47fb-b10e-a68e55799544 could not be found. Aug 09 18:12:50.016925 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:50.019147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Returning 404 to user: Instance d1304d38-6181-47fb-b10e-a68e55799544 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:12:50.019147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d70185ef-aaf6-4b6c-995c-c68914410769 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544" status: 404 len: 111 microversion: 2.1 time: 0.030654 Aug 09 18:12:50.019147 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 573/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:49 2022] GET /compute/v2.1/servers/d1304d38-6181-47fb-b10e-a68e55799544 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:12:53.098190 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:53.099308 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:53.100469 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-8dc63517-6f43-4f55-95ef-f42cd39821e7 req-78745fcb-4e3e-4555-9e72-d0cc70c647b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1", "tag": "8540d200-46e5-4cb0-8416-39bc5a9a72d2"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:53.106555 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:53.107102 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:53.107550 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:53.108259 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:53.108777 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:53.109204 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:53.110880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8dc63517-6f43-4f55-95ef-f42cd39821e7 req-78745fcb-4e3e-4555-9e72-d0cc70c647b4 service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:53.111407 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8dc63517-6f43-4f55-95ef-f42cd39821e7 req-78745fcb-4e3e-4555-9e72-d0cc70c647b4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:53.111809 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8dc63517-6f43-4f55-95ef-f42cd39821e7 req-78745fcb-4e3e-4555-9e72-d0cc70c647b4 service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:53.126441 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-8dc63517-6f43-4f55-95ef-f42cd39821e7 req-78745fcb-4e3e-4555-9e72-d0cc70c647b4 service nova] Creating event network-changed:8540d200-46e5-4cb0-8416-39bc5a9a72d2 for instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 on hv-cinder-83608 Aug 09 18:12:53.132500 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-8dc63517-6f43-4f55-95ef-f42cd39821e7 req-78745fcb-4e3e-4555-9e72-d0cc70c647b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036219 Aug 09 18:12:53.133101 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 574/1125] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:12:53.144770 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:12:53.236207 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c5ce62d-3563-4145-96a0-09bcd1fe0b0c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 204 len: 0 microversion: 2.1 time: 0.141727 Aug 09 18:12:53.240831 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 552/1126] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:12:53 2022] DELETE /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:12:53.246369 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:53.247223 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:53.253951 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:53.254672 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:53.255306 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:53.257471 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:53.258107 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:53.259243 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:53.418497 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:53.426233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-63b2803a-a473-4291-9ce4-86a57cae5960 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1578 microversion: 2.1 time: 0.184185 Aug 09 18:12:53.426812 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 575/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:53 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:54.449828 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:54.450535 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:54.457104 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:54.457589 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:54.458027 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:54.458729 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:54.459813 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:54.460245 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:54.621672 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:54.630013 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-98c7f200-8d05-4c8d-9768-c16d9f8003b0 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1578 microversion: 2.1 time: 0.184315 Aug 09 18:12:54.630617 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 553/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:54 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:12:55.472311 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-ff77c652-ae59-4e6d-8abe-75ceaf12382d req-b7b5356d-35d0-47af-865c-f7cdaf4ab73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1", "name": "network-vif-deleted", "tag": "8540d200-46e5-4cb0-8416-39bc5a9a72d2"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:55.483166 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ff77c652-ae59-4e6d-8abe-75ceaf12382d req-b7b5356d-35d0-47af-865c-f7cdaf4ab73f service nova] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:55.483664 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ff77c652-ae59-4e6d-8abe-75ceaf12382d req-b7b5356d-35d0-47af-865c-f7cdaf4ab73f service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:55.484090 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ff77c652-ae59-4e6d-8abe-75ceaf12382d req-b7b5356d-35d0-47af-865c-f7cdaf4ab73f service nova] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:55.497528 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-ff77c652-ae59-4e6d-8abe-75ceaf12382d req-b7b5356d-35d0-47af-865c-f7cdaf4ab73f service nova] Creating event network-vif-deleted:8540d200-46e5-4cb0-8416-39bc5a9a72d2 for instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 on hv-cinder-83608 Aug 09 18:12:55.502856 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-ff77c652-ae59-4e6d-8abe-75ceaf12382d req-b7b5356d-35d0-47af-865c-f7cdaf4ab73f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Aug 09 18:12:55.503691 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 576/1129] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:12:55.653305 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:55.653903 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:55.660250 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:55.660723 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:55.661157 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:55.661833 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:55.662923 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:55.663546 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:55.729848 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf28be46c9c4d9c9f5a7c5837545fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4821ddb8e299400eba9adc4bc53ebe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:55.739424 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2f0df604-6325-4232-9cc2-13dba08933bc tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 200 len: 1225 microversion: 2.1 time: 0.089906 Aug 09 18:12:55.740363 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 554/1130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:55 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:12:56.769277 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:56.769911 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:56.776179 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:56.776650 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:56.777074 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:56.777751 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:56.778190 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:56.778602 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:56.792331 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] HTTP exception thrown: Instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 could not be found. Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Request method failure captured: Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 HTTP/1.1 Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qIGKF7S_bf4Fmkw5iuHXcM1mGifF0ovhvMODr1hQlA6j6oxcqBMxi-F00l_u8jaiK8w4D1-OiN1JJwKDWNiOZQw6KLs26PR9duhOFSJAtG5X5prja2-WsHlqycWhKxJyqdffHnPiSIgLRCjkZMn87_ICTMzk_uwrASHWOGczxrXBmc Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:12:56.793926 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4821ddb8e299400eba9adc4bc53ebe6b", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 8bf28be46c9c4d9c9f5a7c5837545fa4 Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 could not be found. Aug 09 18:12:56.795720 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1'} Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 could not be found. Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:12:56.796892 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 could not be found. Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 could not be found. Aug 09 18:12:56.798473 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:56.800233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Returning 404 to user: Instance bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:12:56.800233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a9fc1d4-a6f4-4285-b395-0d30a9f049ae tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1" status: 404 len: 111 microversion: 2.1 time: 0.030964 Aug 09 18:12:56.800233 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 577/1131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:56 2022] GET /compute/v2.1/servers/bf84e11f-ad20-47ca-a13d-47b4d6dc5fc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:12:57.524776 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:57.525322 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:57.531950 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:57.532433 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:57.533501 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:57.534208 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:57.534666 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:57.535126 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:57.549200 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] HTTP exception thrown: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Request method failure captured: Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 HTTP/1.1 Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept: application/json Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Connection: close Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Length: 0 Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Content-Type: application/json Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Host: 10.222.0.52 Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.11 Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi8qIGKF7S_bf4Fmkw5iuHXcM1mGifF0ovhvMODr1hQlA6j6oxcqBMxi-F00l_u8jaiK8w4D1-OiN1JJwKDWNiOZQw6KLs26PR9duhOFSJAtG5X5prja2-WsHlqycWhKxJyqdffHnPiSIgLRCjkZMn87_ICTMzk_uwrASHWOGczxrXBmc Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Role: reader,member Aug 09 18:12:57.550883 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4821ddb8e299400eba9adc4bc53ebe6b", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Id: 8bf28be46c9c4d9c9f5a7c5837545fa4 Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: method: > Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: exception: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.552662 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: action_args: {'id': 'd02ce720-286e-4766-8b03-92b699d90db9'} Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:12:57.553805 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.555447 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.557242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Returning 404 to user: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:12:57.557242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-31b032c0-5585-4204-9d0d-35c5e180af74 tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 404 len: 111 microversion: 2.1 time: 0.032216 Aug 09 18:12:57.557242 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 555/1132] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 9 18:12:57 2022] DELETE /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:12:57.561193 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:57.561798 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] [instance: d02ce720-286e-4766-8b03-92b699d90db9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:57.569307 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:57.569785 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:57.570215 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:57.570904 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Acquiring lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:57.571501 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:57.571941 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Lock "96e3c306-cfbc-45b6-873c-ac9c25672dda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:57.586345 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] HTTP exception thrown: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Request method failure captured: Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 HTTP/1.1 Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Connection: close Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Host: 10.222.0.52 Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.11 Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi8qIGKF7S_bf4Fmkw5iuHXcM1mGifF0ovhvMODr1hQlA6j6oxcqBMxi-F00l_u8jaiK8w4D1-OiN1JJwKDWNiOZQw6KLs26PR9duhOFSJAtG5X5prja2-WsHlqycWhKxJyqdffHnPiSIgLRCjkZMn87_ICTMzk_uwrASHWOGczxrXBmc Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Role: reader,member Aug 09 18:12:57.587880 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Roles: reader,member Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4821ddb8e299400eba9adc4bc53ebe6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4821ddb8e299400eba9adc4bc53ebe6b", "adminURL": "http://10.222.0.52:8080"}]}] Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 4821ddb8e299400eba9adc4bc53ebe6b Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448408759 Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Id: 8bf28be46c9c4d9c9f5a7c5837545fa4 Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestVolumeBootPattern-1448408759-project Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: method: > Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: exception: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.589590 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: action_args: {'id': 'd02ce720-286e-4766-8b03-92b699d90db9'} Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:12:57.590537 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. Aug 09 18:12:57.592120 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 09 18:12:57.593598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Returning 404 to user: Instance d02ce720-286e-4766-8b03-92b699d90db9 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:12:57.593598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bba72b40-9fc6-46da-a1e2-69c4bad7c98c tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9" status: 404 len: 111 microversion: 2.1 time: 0.031931 Aug 09 18:12:57.593598 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 578/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:57 2022] GET /compute/v2.1/servers/d02ce720-286e-4766-8b03-92b699d90db9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:12:59.051263 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-991bc876-ce37-48f2-8e2a-95a616efff8b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] Calling method '.version_select at 0x7f8c068bde50>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:59.084340 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-991bc876-ce37-48f2-8e2a-95a616efff8b tempest-TestVolumeBootPattern-1448408759 tempest-TestVolumeBootPattern-1448408759-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-873891623" status: 202 len: 0 microversion: 2.1 time: 0.036775 Aug 09 18:12:59.085142 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 556/1134] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Aug 9 18:12:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-873891623 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:13:44.969683 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:13:44.970329 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Tue Aug 9 18:13:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:13:55.821352 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 09 18:13:55.822089 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Tue Aug 9 18:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:13:56.894039 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:13:56.894608 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Tue Aug 9 18:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:16:20.259724 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:16:20.260982 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Tue Aug 9 18:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:16:46.469247 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:16:46.469966 dv-cinder-836083-11-iscsi devstack@n-api.service[117885]: Tue Aug 9 18:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:16:50.937112 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:16:50.937711 dv-cinder-836083-11-iscsi devstack@n-api.service[117886]: Tue Aug 9 18:16:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!